-- Logs begin at Wed 2022-11-02 06:46:16 UTC, end at Wed 2022-11-02 08:07:09 UTC. -- Nov 02 07:23:52.641377 dv-cinder-804735-33-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 07:23:52.651095 dv-cinder-804735-33-smb devstack@keystone.service[81600]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 07:23:52 2022] *** Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: nodename: dv-cinder-804735-33-smb Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: machine: x86_64 Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: clock source: unix Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: pcre jit disabled Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: detected number of CPU cores: 4 Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: current working directory: / Nov 02 07:23:52.653062 dv-cinder-804735-33-smb devstack@keystone.service[81600]: detected binary path: /usr/bin/uwsgi-core Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: your processes number limit is 47680 Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: your memory page size is 4096 bytes Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: detected max file descriptor number: 2048 Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: lock engine: pthread robust mutexes Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: thunder lock: enabled Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 07:23:52.653740 dv-cinder-804735-33-smb devstack@keystone.service[81600]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 07:23:52.691989 dv-cinder-804735-33-smb devstack@keystone.service[81600]: Python main interpreter initialized at 0x56243dfa79c0 Nov 02 07:23:52.691989 dv-cinder-804735-33-smb devstack@keystone.service[81600]: python threads support enabled Nov 02 07:23:52.691989 dv-cinder-804735-33-smb devstack@keystone.service[81600]: your server socket listen backlog is limited to 100 connections Nov 02 07:23:52.691989 dv-cinder-804735-33-smb devstack@keystone.service[81600]: your mercy for graceful operations on workers is 90 seconds Nov 02 07:23:52.692324 dv-cinder-804735-33-smb devstack@keystone.service[81600]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 07:23:52.692401 dv-cinder-804735-33-smb devstack@keystone.service[81600]: *** Operational MODE: preforking *** Nov 02 07:23:52.692664 dv-cinder-804735-33-smb devstack@keystone.service[81600]: *** uWSGI is running in multiple interpreter mode *** Nov 02 07:23:52.692664 dv-cinder-804735-33-smb devstack@keystone.service[81600]: spawned uWSGI master process (pid: 81600) Nov 02 07:23:52.692863 dv-cinder-804735-33-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 07:23:52.697566 dv-cinder-804735-33-smb devstack@keystone.service[81600]: spawned uWSGI worker 1 (pid: 81612, cores: 1) Nov 02 07:23:52.697566 dv-cinder-804735-33-smb devstack@keystone.service[81600]: spawned uWSGI worker 2 (pid: 81613, cores: 1) Nov 02 07:23:52.697566 dv-cinder-804735-33-smb devstack@keystone.service[81600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 07:23:56.973463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:23:56.973463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: from cryptography.utils import int_from_bytes Nov 02 07:23:56.974257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:23:56.974257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Nov 02 07:23:56.974257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:23:56.974257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Nov 02 07:23:56.974761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:23:56.974761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: from cryptography.utils import int_from_bytes Nov 02 07:23:57.028966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:23:57.029134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:23:57.029216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:23:57.029304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:23:57.029382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] command line args: [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:23:57.029474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] command line args: [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:23:57.029636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:23:57.029730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:23:57.029805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ================================================================================ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:23:57.029902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ================================================================================ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:23:57.030028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] admin_token = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_dir = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_dir = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_source = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_source = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] debug = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.030958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] debug = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.031879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_config_append = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_config_append = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_dir = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_dir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.032942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.033930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.034955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035266 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.035981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.036128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.036204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.036399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.036484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.036883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.036960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.037064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] publish_errors = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.037140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] publish_errors = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.037294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.037369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.037523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.038985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] standard_threads = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] standard_threads = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_journal = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_journal = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_json = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_json = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_stderr = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.039994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_stderr = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.040089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_syslog = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.040214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_syslog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.040302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.040380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:23:57.040455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.040978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.041914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042082 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.042868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.043992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.044976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.045847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.046926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.047988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.048896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.049984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.050915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.051954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.052996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.053972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.054943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.055938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.056918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.057871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.058985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.059927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.060959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.061955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.062875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063550 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.063930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.064975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.external = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.external = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.065944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.password = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066689 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.password = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.token = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.066907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.token = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.067848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.068953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.069029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.069197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.069281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.069962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.070052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.070217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.070293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.070495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.070574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.072648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.072728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.072788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.072844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.072900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.072955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.073955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.074955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.075924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.076995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.077877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.078901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.079876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.080994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081298 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.081951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.082986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.083947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084552 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.084881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.085698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.085791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.085948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086519 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.086918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.087958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.088957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.089897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.090969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.091998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.092954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.093926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.094866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.095972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.096992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.097960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.098743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.098900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.098983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.099939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.100960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.101927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.102962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.103994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.104976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.105962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106198 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.106938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.107918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.108864 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.109838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.110954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111798 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.111923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.112998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.113960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.114114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.116978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:23:57.117882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:23:57.117980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:23:57.146861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.147007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.147072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.147163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.147305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.147387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.156249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.156347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.185326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.185568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.185652 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.185836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.243997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.244114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.292680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.292911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.293064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.293302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.448590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.448778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.448851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.448926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.449742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.472369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.472477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.472582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.472695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.472807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.472889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.473785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.491917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.492114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.504603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.504789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.504874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.505993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.506126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:23:57.523640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.523850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:23:57.523976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.524188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:23:57.524267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.524392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:23:57.524527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.524667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.524746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:23:57.524990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.525174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.525442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.525718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.525802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.525874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.526035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.535062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.535381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.535474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.535648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.535728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.535918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.536007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.536202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.542895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.543182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.545803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.546089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.546171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.546374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.546499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.546706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.546810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.546942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.547821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.548952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.572074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.572402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.573522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.573828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.573909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.574138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.580182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.580469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.580551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.580752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.580833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.581090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.587231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.587517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.587739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.588033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.591654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.591945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.592187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.592270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.592479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.592564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.592765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.592845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.593909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.594186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.609568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.609835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.610184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.610464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.613657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.614305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.617465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.617784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.618090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.618390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.621956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.622634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.625055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.625772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.628292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.628595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.628883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.638591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.638721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.638809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.638893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.638967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.639047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.639121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.639121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.639121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.645672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.645959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.646226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.646416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.646497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.646708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.646978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.647247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.653303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.654108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.654869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.655701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.656417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.656696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.657244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.657524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.659337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.659624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.660020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.660172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.660307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.660459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.660597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.660849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.661136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.661430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.672152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.672461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.672829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.673075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.673157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.673375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.673457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.673713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.673794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.673997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.674091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.674331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.674626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.674906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.689781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.690788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.692628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.693703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.695609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.696597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.697027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.701994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.702086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.702086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.702086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.702264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.702264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.702264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.705420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.706468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.706921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.707970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.709903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.710221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.710509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.710787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.710992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.711284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.711569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.711847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.718517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.718810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.719095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.719697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.719990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.720271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.727319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.727602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.727883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.728158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.728429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.728573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:23:57.728702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.728860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.728979 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.729996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.730955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.731146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.731419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.731683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.731950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.732221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:23:57.764230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56243dfa79c0 pid: 81613 (default app) Nov 02 07:23:57.765450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56243dfa79c0 pid: 81612 (default app) Nov 02 07:23:57.767527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04be0-f45b-478f-8100-161d7b73975a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.767814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04be0-f45b-478f-8100-161d7b73975a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.768087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d04be0-f45b-478f-8100-161d7b73975a None None] PATH_INFO: `/v3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.772457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Wed Nov 2 07:23:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:05.164372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:05.164879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:05.164958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:05.169115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:05.174437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:05.174942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:05.175032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:05.244582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: INFO dbcounter [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] Registered counter for database keystone Nov 02 07:24:05.264038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG oslo_db.sqlalchemy.engines [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:24:05.270672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writer thread running {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:24:05.446904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG passlib.handlers.bcrypt [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81613) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:24:05.447224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG passlib.handlers.bcrypt [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81613) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:24:05.504327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:05.505966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:05.630695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:24:06.084824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:06.153892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: INFO dbcounter [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] Registered counter for database keystone Nov 02 07:24:06.175621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG oslo_db.sqlalchemy.engines [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:24:06.182413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writer thread running {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:24:06.300094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92ebf-a04c-455b-9269-9d77984b5e3f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:06.304327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:06.304969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.305249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.305520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.313677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:06.366329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING keystone.common.rbac_enforcer.enforcer [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:24:06.366623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf647c-3cbf-4ffe-bd3a-4238686becd1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:06.375786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Wed Nov 2 07:24:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:24:06.381700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:06.399344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9ce30-88e7-48ec-8861-b7782920f21b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:06.403653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:06.404757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.405037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.405306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] PATH_INFO: `/v3/projects/a48f833e014547bea9a266aeb3854e0b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.409042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=a48f833e014547bea9a266aeb3854e0b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:06.459945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING keystone.common.rbac_enforcer.enforcer [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:24:06.460286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a42e7-328e-4f38-b7ad-30d0f9a4f3a7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:06.465173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Nov 2 07:24:06 2022] GET /identity/v3/projects/a48f833e014547bea9a266aeb3854e0b => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:08.572152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98acc4-0d81-4057-8def-15fd0a3206d9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:08.572621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98acc4-0d81-4057-8def-15fd0a3206d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:08.572621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98acc4-0d81-4057-8def-15fd0a3206d9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:08.576627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:08.581958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:08.582338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:08.582511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:08.602208 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:08.603735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:08.611361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:24:08.879744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98acc4-0d81-4057-8def-15fd0a3206d9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:08.891638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98acc4-0d81-4057-8def-15fd0a3206d9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:08.896043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548f81b-b0db-4fd3-845b-407633905080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:08.896647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548f81b-b0db-4fd3-845b-407633905080 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:08.896929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548f81b-b0db-4fd3-845b-407633905080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:08.897203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548f81b-b0db-4fd3-845b-407633905080 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:08.904740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548f81b-b0db-4fd3-845b-407633905080 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:08.906529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548f81b-b0db-4fd3-845b-407633905080 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:08.915592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Wed Nov 2 07:24:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:24:08.920742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:08.930230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf927bb-394b-49b2-a140-13904944cc48 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:08.934469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc00d-8bb9-44a2-9d95-788117ae9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:08.935080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc00d-8bb9-44a2-9d95-788117ae9182 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:08.935359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc00d-8bb9-44a2-9d95-788117ae9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:08.935630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc00d-8bb9-44a2-9d95-788117ae9182 admin admin] PATH_INFO: `/v3/users/395a2fc08e264060911329b9f2474d01` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:08.936921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbc00d-8bb9-44a2-9d95-788117ae9182 admin admin] RBAC: Authorizing `identity:get_user(user_id=395a2fc08e264060911329b9f2474d01)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:08.938803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbc00d-8bb9-44a2-9d95-788117ae9182 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:08.940272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Wed Nov 2 07:24:08 2022] GET /identity/v3/users/395a2fc08e264060911329b9f2474d01 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:11.114084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ca24f-a806-4451-8ebe-a4452e523261 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.114593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ca24f-a806-4451-8ebe-a4452e523261 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.114674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ca24f-a806-4451-8ebe-a4452e523261 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.115957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:11.121480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.121901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.122177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.140072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:11.141263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:11.166461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17dbaf-7552-4e75-9a2d-a55e664a430e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.166749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17dbaf-7552-4e75-9a2d-a55e664a430e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.167032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17dbaf-7552-4e75-9a2d-a55e664a430e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.168346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:11.173303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.173612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.173886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.214847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81612) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:24:11.215236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81612) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:24:11.225592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:11.264611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:11.266229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:11.362954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:11.489317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:11.512361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:11.591876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2867d-a801-4d51-9424-889ba45b65df None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:11.624849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:11.625477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.625781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.626054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.629209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:11.637492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:11.646717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:11.647560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:11.648816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:11.654186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:11.727665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f782-2585-4ea0-b539-e92044571a96 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:11.730326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:11.732983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:11.751719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad58ac1-7dc4-4a4f-bdb4-7e9a65d51627 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:11.764581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:11.765687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.765967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.766239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.767209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:11.768881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:11.784906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:11.785501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.785806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.786076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.786730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:11.787029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:11.788401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:11.799692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:11.805770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:11.827692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:24:11.827692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:24:11.827692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [parameters: {'id': 'b9118013888749dba3243d620f31bf10', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:24:11.827692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:24:11.846198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:24:11.847017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:24:11.847876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:24:11.848673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:24:11.849622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:24:11.850328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'id': 'b9118013888749dba3243d620f31bf10', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:24:11.851098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:11.852277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:11.853437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 8/16] 10.222.0.26 () {60 vars in 1137 bytes} [Wed Nov 2 07:24:11 2022] POST /identity/v3/domains => generated 190 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:11.854240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:11.908416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9857ed6-a27d-45d6-8a7f-7248a4cf0a5b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:11.941723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:11.942353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.942632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.942906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] PATH_INFO: `/v3/users/395a2fc08e264060911329b9f2474d01` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:11.944040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] RBAC: Authorizing `identity:get_user(user_id=395a2fc08e264060911329b9f2474d01)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:11.945479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:11.947076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:11 2022] GET /identity/v3/users/395a2fc08e264060911329b9f2474d01 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:11.950112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02080662-0a57-46dc-85de-a3b453f2c880 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:11.952707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:11.966346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:11.984179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:11.985039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:11.985320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:11.985623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.005907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:12.007310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:24:12.024871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:12.025745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:24:12.026520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:24:12.026520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:24:12.026520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:12.026520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:12.031720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:12.051664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009fbb-2fd6-4b1b-98c3-b613647cecd2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:12.056660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:12.085557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:12.086230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.086514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.086792 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.087905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:12.089337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:12.091135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:12.096501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:12.135759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e6ff-aeee-4d68-95fd-b28271297859 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:12.168903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:12.169512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.169820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.170095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.170739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:12.171048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:12.172437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5684593-dc68-4c22-9e26-b39e2346563f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:12.175152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:12.189992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:12.194371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1509-bdc7-4c34-9ea0-4b7d23670cc7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:12.235217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89324e0f-9e77-4c90-8ee7-49af8074782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:12.235889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324e0f-9e77-4c90-8ee7-49af8074782a None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.236171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324e0f-9e77-4c90-8ee7-49af8074782a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.236450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324e0f-9e77-4c90-8ee7-49af8074782a None admin] PATH_INFO: `/v3/domains/default/users/395a2fc08e264060911329b9f2474d01/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.238453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324e0f-9e77-4c90-8ee7-49af8074782a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=395a2fc08e264060911329b9f2474d01, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:12.239934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324e0f-9e77-4c90-8ee7-49af8074782a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:12.418854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1361 bytes} [Wed Nov 2 07:24:12 2022] PUT /identity/v3/domains/default/users/395a2fc08e264060911329b9f2474d01/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:24:14.956349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8412b-f736-470b-8dd8-e4a9cab0020e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:14.956854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8412b-f736-470b-8dd8-e4a9cab0020e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:14.956926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8412b-f736-470b-8dd8-e4a9cab0020e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:14.958549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:14.964703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dfba6-9775-4bb6-910e-1e941674e39e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:14.965124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dfba6-9775-4bb6-910e-1e941674e39e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:14.965342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dfba6-9775-4bb6-910e-1e941674e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:14.987848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a68dfba6-9775-4bb6-910e-1e941674e39e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:14.989355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a68dfba6-9775-4bb6-910e-1e941674e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:15.011240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb73a8d-becf-4de0-be89-ad16d126c748 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.011537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb73a8d-becf-4de0-be89-ad16d126c748 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.011779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb73a8d-becf-4de0-be89-ad16d126c748 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.013117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 12/23] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:15.022324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d22d-8ed2-4d78-bed3-325f4a3db100 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.022614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d22d-8ed2-4d78-bed3-325f4a3db100 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.022862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d22d-8ed2-4d78-bed3-325f4a3db100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.049088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3422d22d-8ed2-4d78-bed3-325f4a3db100 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:15.050340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3422d22d-8ed2-4d78-bed3-325f4a3db100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:15.113621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:15.167734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c292b-8195-41e6-98e1-f01ff3b80f03 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.168049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c292b-8195-41e6-98e1-f01ff3b80f03 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.168286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c292b-8195-41e6-98e1-f01ff3b80f03 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.172549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 13/25] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:15.178698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1e4ea-40eb-4373-9cd6-95527bb71cc3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.178976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1e4ea-40eb-4373-9cd6-95527bb71cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.179258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1e4ea-40eb-4373-9cd6-95527bb71cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.194742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:15.203806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6cf1e4ea-40eb-4373-9cd6-95527bb71cc3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:15.204997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6cf1e4ea-40eb-4373-9cd6-95527bb71cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:15.298945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:15.307941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:15.325267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d9207-333f-4772-8382-5ba24b5ee08b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.325880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d9207-333f-4772-8382-5ba24b5ee08b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.326350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d9207-333f-4772-8382-5ba24b5ee08b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.327871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 14/28] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:15.333271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.333597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.333870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.361767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:15.363264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:15.456668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:15.469231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d9207-333f-4772-8382-5ba24b5ee08b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.490528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:15.601586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d9207-333f-4772-8382-5ba24b5ee08b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.620635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.671836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.672874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.673370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.673882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.704304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:15.711750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:15.712559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:15.713311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:15.715655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:15.721484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.818750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ba28-4179-4f06-b943-61e376b0cac2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.848134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:15.863205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:15.871079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.871759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.872199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.872540 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.873790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:15.875670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:15.888180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b0bdc-b57f-4d8c-b085-3445dde076c6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.927379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.948990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.948990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.948990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.948990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:15.948990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:15.948990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:15.949416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 16/31] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:15.949416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.024922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 16/32] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Nov 2 07:24:15 2022] POST /identity/v3/roles => generated 219 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:16.041790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.092520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e75a-ee65-4b68-acb8-951633d48d82 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.174755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.185599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.188773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.188773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.188773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.208649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.210560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:24:16.228153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:16.229361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:24:16.230373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:24:16.230373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:24:16.230373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:16.232246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:16.233418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.239877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c6d42-a9ad-408a-915c-62220b4996a0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.292095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.293072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.293189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.293589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.294331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.295891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.357261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f3ff9-b2d3-4b3e-a77a-0d0232bb064f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.360190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 17/34] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Nov 2 07:24:16 2022] POST /identity/v3/roles => generated 225 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:16.367658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.401464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4197-7e80-405d-bf66-11b5c4e2feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.402731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4197-7e80-405d-bf66-11b5c4e2feb8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.403682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4197-7e80-405d-bf66-11b5c4e2feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.404482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4197-7e80-405d-bf66-11b5c4e2feb8 None admin] PATH_INFO: `/v3/users/395a2fc08e264060911329b9f2474d01` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.406318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b4197-7e80-405d-bf66-11b5c4e2feb8 None admin] RBAC: Authorizing `identity:get_user(user_id=395a2fc08e264060911329b9f2474d01)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.408318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b4197-7e80-405d-bf66-11b5c4e2feb8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.411255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 18/35] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/users/395a2fc08e264060911329b9f2474d01 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:16.414436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995baaa-670d-410f-93b5-07090592a420 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.414436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995baaa-670d-410f-93b5-07090592a420 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.414436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995baaa-670d-410f-93b5-07090592a420 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.415707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:16.421072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995baaa-670d-410f-93b5-07090592a420 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.436149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.497238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.511656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4083e2-4f1c-4dfa-ae5f-68ce2e53b386 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.562195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.562853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.563105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.563383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.564071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:16.564380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.565862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d2ef-f2e3-48da-8123-664bd02290e4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.566714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995baaa-670d-410f-93b5-07090592a420 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.588697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 18/37] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:16.590129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.590488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.590776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.606348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.606992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.607390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.607613 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.608742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.610265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.611846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:16.612123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:16.612586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.613871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:16.691399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 19/39] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:16.692556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.742559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.745012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9aeb2-205a-4b90-a47d-eeb6b5c8c203 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.766832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.781401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.782052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.782333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.782610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.783259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.784759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.809213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4fbf-456c-476b-91b9-61d992a23303 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.844774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.845380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.845695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.845969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.846695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.domain.id=default, user.id=395a2fc08e264060911329b9f2474d01) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:16.847006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.848451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757d5f7-f191-43ca-85d0-2f3dd2866f0b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.861743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 20/40] 10.222.0.26 () {56 vars in 1322 bytes} [Wed Nov 2 07:24:16 2022] GET /identity/v3/role_assignments?user.id=395a2fc08e264060911329b9f2474d01&scope.domain.id=default&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:16.861743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1414-9e6a-43b6-9e69-5a5b7941fe7d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.861743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1414-9e6a-43b6-9e69-5a5b7941fe7d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.861743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1414-9e6a-43b6-9e69-5a5b7941fe7d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.861743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 21/41] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:16.865093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.865351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.865658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.967905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:24:16 2022] POST /identity/v3/projects => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:16.979300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.997058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:16.998374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:17.094202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:17.118701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2734-9548-4a7e-801a-811915e85e18 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:17.157447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:17.158099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:17.158385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:17.158661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:17.159340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:17.160898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:17.231530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Nov 2 07:24:16 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:17.369860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:17.405835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:17.471078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad48a11-b04e-409d-aedf-e92ff6d6544c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:17.503820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942af5d-8003-45e4-80c2-b3034dcddc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:17.504450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942af5d-8003-45e4-80c2-b3034dcddc52 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:17.504736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942af5d-8003-45e4-80c2-b3034dcddc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:17.505014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942af5d-8003-45e4-80c2-b3034dcddc52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:17.506134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942af5d-8003-45e4-80c2-b3034dcddc52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:17.508183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942af5d-8003-45e4-80c2-b3034dcddc52 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:17.509775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:17.515415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:17.545723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:17.610253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0a2e0-129a-4739-8198-bdd008785c78 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:17.643954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37883581-de3d-4e17-95e3-fd2acd4ea433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:17.644501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37883581-de3d-4e17-95e3-fd2acd4ea433 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:17.644784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37883581-de3d-4e17-95e3-fd2acd4ea433 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:17.645078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37883581-de3d-4e17-95e3-fd2acd4ea433 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:17.645759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37883581-de3d-4e17-95e3-fd2acd4ea433 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:17.647202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37883581-de3d-4e17-95e3-fd2acd4ea433 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:17.742883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:24:17 2022] POST /identity/v3/projects => generated 312 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:19.890281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db729af-e768-4f5a-bc1e-4c29d62a3b97 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.890789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db729af-e768-4f5a-bc1e-4c29d62a3b97 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.890868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db729af-e768-4f5a-bc1e-4c29d62a3b97 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.892212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:19.897854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.898809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.898894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.917297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:19.918818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:19.981299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:20.247351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db729af-e768-4f5a-bc1e-4c29d62a3b97 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:20.346818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db729af-e768-4f5a-bc1e-4c29d62a3b97 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:20.348293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:20.379619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320932b8-88c0-4a9c-8c42-124316ed2948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:20.380241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320932b8-88c0-4a9c-8c42-124316ed2948 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:20.380587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320932b8-88c0-4a9c-8c42-124316ed2948 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:20.380885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320932b8-88c0-4a9c-8c42-124316ed2948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:20.381998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320932b8-88c0-4a9c-8c42-124316ed2948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:20.384524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320932b8-88c0-4a9c-8c42-124316ed2948 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:20.386092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:20.391586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:20.406793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:20.486380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80ff1-1921-45d4-8923-0f91c680fcd7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:20.519209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce01217-3b34-4817-ab7c-9ce170339d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:20.519803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce01217-3b34-4817-ab7c-9ce170339d92 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:20.520082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce01217-3b34-4817-ab7c-9ce170339d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:20.520356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce01217-3b34-4817-ab7c-9ce170339d92 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:20.521004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce01217-3b34-4817-ab7c-9ce170339d92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:20.522466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce01217-3b34-4817-ab7c-9ce170339d92 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:20.593154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1140 bytes} [Wed Nov 2 07:24:20 2022] POST /identity/v3/projects => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:22.723751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672735fc-2949-4c6b-9ea9-1a53093b0704 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:22.724267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672735fc-2949-4c6b-9ea9-1a53093b0704 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:22.724352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672735fc-2949-4c6b-9ea9-1a53093b0704 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:22.725671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 26/51] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:22.731343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:22.731733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:22.731907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:22.749666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:22.750847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:22.808915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:22.815987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:23.084604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672735fc-2949-4c6b-9ea9-1a53093b0704 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:23.181923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672735fc-2949-4c6b-9ea9-1a53093b0704 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:23.214705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd2acd-a8f2-4405-83ff-51f500850621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:23.215319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd2acd-a8f2-4405-83ff-51f500850621 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:23.215601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd2acd-a8f2-4405-83ff-51f500850621 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:23.215875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd2acd-a8f2-4405-83ff-51f500850621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:23.216971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd2acd-a8f2-4405-83ff-51f500850621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:23.218419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd2acd-a8f2-4405-83ff-51f500850621 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:23.219955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:23.225488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:23.423248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ec52-8dc4-44be-b80d-dbe3f83a9ae1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:23.455276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ac66a-dfec-4323-84a4-d57582ce21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:23.455867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ac66a-dfec-4323-84a4-d57582ce21d5 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:23.456144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ac66a-dfec-4323-84a4-d57582ce21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:23.456416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ac66a-dfec-4323-84a4-d57582ce21d5 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:23.457061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ac66a-dfec-4323-84a4-d57582ce21d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:23.458482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ac66a-dfec-4323-84a4-d57582ce21d5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:23.563712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 27/54] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:23 2022] POST /identity/v3/users => generated 275 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:26.866853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473bc0f-e9e2-461c-9ffd-6d772d518f12 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:26.867950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473bc0f-e9e2-461c-9ffd-6d772d518f12 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:26.868450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473bc0f-e9e2-461c-9ffd-6d772d518f12 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:26.870137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 28/55] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:26.875918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ff3af-5b91-41e8-aa78-32012f504908 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:26.876843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ff3af-5b91-41e8-aa78-32012f504908 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:26.877329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ff3af-5b91-41e8-aa78-32012f504908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:26.892456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee41d8-2aa3-493e-957d-85b643b61176 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:26.893067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee41d8-2aa3-493e-957d-85b643b61176 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:26.893823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee41d8-2aa3-493e-957d-85b643b61176 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:26.895397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 29/56] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:26.901749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb782d-7403-4ca0-b2a8-ce09594ec0d8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:26.902459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb782d-7403-4ca0-b2a8-ce09594ec0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:26.903027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb782d-7403-4ca0-b2a8-ce09594ec0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:26.907899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9c0ff3af-5b91-41e8-aa78-32012f504908 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:26.909069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c0ff3af-5b91-41e8-aa78-32012f504908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:26.934568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cceb782d-7403-4ca0-b2a8-ce09594ec0d8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:26.935777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cceb782d-7403-4ca0-b2a8-ce09594ec0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:26.962669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:26.979582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 28/57] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:27.017189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:27.082901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:27.094122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852af2-9e84-4c18-9e69-e9cc26ca3315 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.094429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852af2-9e84-4c18-9e69-e9cc26ca3315 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.094688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852af2-9e84-4c18-9e69-e9cc26ca3315 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.096176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 29/59] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:27.101323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.101671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.101958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.130981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:27.132072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:27.183066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06780d23-7bbd-49d4-86fc-c469c8194da3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.183368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06780d23-7bbd-49d4-86fc-c469c8194da3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.183627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06780d23-7bbd-49d4-86fc-c469c8194da3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.184980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 30/60] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:27.189988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.190277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.190552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.213352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:27.215054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:27.231399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 31/61] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:27.286698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 31/62] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:27.331179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.364202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.501297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:27.506895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa067-6f02-4a66-9c3d-ffd4123b520c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:27.523515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356fd41-5392-4518-a1c9-5ca03af214d4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:27.557879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:27.567603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:27.568541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.569035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.569510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.575836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:27.576713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.577196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.577804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.583143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:27.588542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:27.589621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:27.590447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:27.591217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 32/63] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:27.591902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:27.597653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:27.598512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:27.599237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 32/64] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:27.599943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.704299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9c054-a00d-4bd2-8d55-d24d91a0f165 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:27.716340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e69b9-1153-480e-8202-37319a34ee00 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:27.740118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:27.740748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.741030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.741309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.742102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:27.743064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:27.744492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:27.753486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:27.754086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.754373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.754654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.757812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 33/65] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:27.759371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.770741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:27.775966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:27.776976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:27.777774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 33/66] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:27.778390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.797903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:27.799615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:27.862803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01a08-c6b7-4a78-8cb2-6e50f0354c76 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:27.877081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d8b84-fafc-448c-97ae-f380ead4bcf8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:27.896003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:27.896634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.896914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.897189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.907619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:27.910429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:27.911033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:27.911320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:27.911598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:27.912264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:27.912574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:27.912792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:27.913626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:27.914937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 34/67] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:27.915538 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:27.915608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:27.923522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 34/68] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:27.924206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.001475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.010971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.014582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef022d0-da29-4927-8f82-8d27539ddfbd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.020078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57c9de-94ac-4960-a498-8c06124da169 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.047880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783f65f-52dd-4aed-ab6c-b7a4886bf091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.048585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f65f-52dd-4aed-ab6c-b7a4886bf091 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.048794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f65f-52dd-4aed-ab6c-b7a4886bf091 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.049110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783f65f-52dd-4aed-ab6c-b7a4886bf091 None admin] PATH_INFO: `/v3/users/395a2fc08e264060911329b9f2474d01` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.051475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783f65f-52dd-4aed-ab6c-b7a4886bf091 None admin] RBAC: Authorizing `identity:get_user(user_id=395a2fc08e264060911329b9f2474d01)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.052919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783f65f-52dd-4aed-ab6c-b7a4886bf091 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.054131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.054522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/users/395a2fc08e264060911329b9f2474d01 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.054742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.055026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.055359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.055644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ad57-e4e1-4571-8e99-97bf5f5fcd1b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.055931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ad57-e4e1-4571-8e99-97bf5f5fcd1b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.056023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:28.056212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ad57-e4e1-4571-8e99-97bf5f5fcd1b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.056367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.057585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 36/70] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:28.058139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ad57-e4e1-4571-8e99-97bf5f5fcd1b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.061790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:24:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.160534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ad57-e4e1-4571-8e99-97bf5f5fcd1b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.168974 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1b79-db01-4450-9c90-f64a4553137c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.193608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.194210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.194492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.194776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.195457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:28.195764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.197130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.202112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaf4fe-fad2-437d-8545-ad59d27f167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.202840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf4fe-fad2-437d-8545-ad59d27f167a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.203127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf4fe-fad2-437d-8545-ad59d27f167a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.203402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf4fe-fad2-437d-8545-ad59d27f167a None admin] PATH_INFO: `/v3/users/f92a7df2f1e64a229f21b941d7cd789e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.205490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.206401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.215804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.218336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaf4fe-fad2-437d-8545-ad59d27f167a None admin] RBAC: Authorizing `identity:get_user(user_id=f92a7df2f1e64a229f21b941d7cd789e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.220537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaf4fe-fad2-437d-8545-ad59d27f167a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.222658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/users/f92a7df2f1e64a229f21b941d7cd789e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.223845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.224137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.224415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.234840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.242388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:28.243648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:28.306565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41ef4-20a2-46fb-bdce-357143411494 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.308688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 37/74] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:28.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.342148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.343070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.343356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.343631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.344771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.346674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.352897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.352897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.433520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6948d-7b02-4d23-b987-6418351cfa56 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.444674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.455730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a97d-04ef-427b-9e49-882bcd2c13fa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.465490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.470985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.471616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.472128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.472242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] PATH_INFO: `/v3/users/f92a7df2f1e64a229f21b941d7cd789e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.473392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f92a7df2f1e64a229f21b941d7cd789e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.474916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.476658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 38/76] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/users/f92a7df2f1e64a229f21b941d7cd789e => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.478383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.495390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.496068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.496348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.496624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] PATH_INFO: `/v3/users/f92a7df2f1e64a229f21b941d7cd789e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.497793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=f92a7df2f1e64a229f21b941d7cd789e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.499255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.505297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/users/f92a7df2f1e64a229f21b941d7cd789e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.505297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.589926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d860b-0272-4af6-aaba-8668d74185b0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.606270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f80bc-4410-4e10-a2a9-07e9e2b10ca0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.621982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.622612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.622898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.623171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.624302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.625792 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.627413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.628175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.641748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.642411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.642695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.642974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/395a2fc08e264060911329b9f2474d01/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.645152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=5152f238881e4a83b5506e208ad7f86f, user_id=395a2fc08e264060911329b9f2474d01, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.646625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.693109 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.708071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 40/79] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:28 2022] PUT /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/395a2fc08e264060911329b9f2474d01/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:28.708920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.730251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630a6b-3aae-44f9-9237-2d06f5c8f99f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.736048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.769624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.770284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.770568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.770841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.772065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.773580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.775407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 40/80] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.776206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.838567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75b21-004d-46bb-8416-09905eba6c82 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.879675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.880186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.880429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.880713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] PATH_INFO: `/v3/projects/b8264c92d82b46b2a846307145a484f5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.882551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b8264c92d82b46b2a846307145a484f5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.884586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.886313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/projects/b8264c92d82b46b2a846307145a484f5 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.887103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.887749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e899-81f7-49f1-bd8c-c6ca897e3c70 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:28.923810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:28.924447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:28.924734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:28.925012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:28.926141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:28.927612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:28.929193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:28.930465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:28.933145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:28.990227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:29.003376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3fb2a-6a2a-45c6-bb82-e8fdc9dde6a3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:29.034347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c98f-e167-43dc-b8a3-5d3296b8c7b6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:29.040780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:29.041440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:29.041760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:29.042045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/f92a7df2f1e64a229f21b941d7cd789e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:29.043968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] RBAC: Authorizing `identity:create_grant(project_id=5152f238881e4a83b5506e208ad7f86f, user_id=f92a7df2f1e64a229f21b941d7cd789e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:29.045425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:29.068599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:29.069285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:29.069621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:29.069902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/f92a7df2f1e64a229f21b941d7cd789e/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:29.072651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] RBAC: Authorizing `identity:create_grant(project_id=5152f238881e4a83b5506e208ad7f86f, user_id=f92a7df2f1e64a229f21b941d7cd789e, role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:29.074123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:29.148395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 42/83] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:28 2022] PUT /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/f92a7df2f1e64a229f21b941d7cd789e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:29.149783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:29.174197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 42/84] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:28 2022] PUT /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/f92a7df2f1e64a229f21b941d7cd789e/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:29.176481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:29.267335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:29.351926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017d8fa-3ede-4512-bf09-5a49cb577321 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:29.363265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5122a-72ad-4b4f-bc6b-2b043e1f48fb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:29.392036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc1fc-3569-41f8-974b-7c7a12143b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:29.392661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc1fc-3569-41f8-974b-7c7a12143b1f None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:29.392948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc1fc-3569-41f8-974b-7c7a12143b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:29.393226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc1fc-3569-41f8-974b-7c7a12143b1f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:29.394212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bc1fc-3569-41f8-974b-7c7a12143b1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:29.395746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bc1fc-3569-41f8-974b-7c7a12143b1f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:29.406673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf5b65-c14a-44b3-a193-8a1d0d9239d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:29.407275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5b65-c14a-44b3-a193-8a1d0d9239d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:29.407590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5b65-c14a-44b3-a193-8a1d0d9239d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:29.407946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf5b65-c14a-44b3-a193-8a1d0d9239d1 None admin] PATH_INFO: `/v3/projects/b8264c92d82b46b2a846307145a484f5/users/f92a7df2f1e64a229f21b941d7cd789e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:29.410129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf5b65-c14a-44b3-a193-8a1d0d9239d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8264c92d82b46b2a846307145a484f5, user_id=f92a7df2f1e64a229f21b941d7cd789e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:29.411744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf5b65-c14a-44b3-a193-8a1d0d9239d1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:29.480161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 43/85] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:29 2022] PUT /identity/v3/projects/b8264c92d82b46b2a846307145a484f5/users/f92a7df2f1e64a229f21b941d7cd789e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:29.510014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 43/86] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:29 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:31.040127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12fafe-f29d-46d4-81ee-d06996357911 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.040668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12fafe-f29d-46d4-81ee-d06996357911 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.040668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12fafe-f29d-46d4-81ee-d06996357911 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.042160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 44/87] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:31.047530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.047942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.048127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.070548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:31.071732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:31.150759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 44/88] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:31.696046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12fafe-f29d-46d4-81ee-d06996357911 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:31.707584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:31.810869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12fafe-f29d-46d4-81ee-d06996357911 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:31.851177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:31.851891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:31.852174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:31.852447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:31.865670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:31.871490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:31.872399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:31.873126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:31.884665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 45/89] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:31.884800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:31.941128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:32.003447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd43e85-bae7-409c-a6b4-a3a9f95a100a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:32.050284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:32.051032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.051251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.051525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.052229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:32.052542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:32.054032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cb2f4-6d7b-4498-ad68-3372b4bc7149 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:32.066854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 45/90] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:32.072797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:32.121653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799dee-4bc7-4d18-af61-34c30eb32407 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.121964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799dee-4bc7-4d18-af61-34c30eb32407 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.122213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799dee-4bc7-4d18-af61-34c30eb32407 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.123576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 46/91] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:32.129207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962131-f3c6-428b-8d73-adb125758130 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.129512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962131-f3c6-428b-8d73-adb125758130 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.129793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962131-f3c6-428b-8d73-adb125758130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.156415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b5962131-f3c6-428b-8d73-adb125758130 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:32.157712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b5962131-f3c6-428b-8d73-adb125758130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:32.179446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:32.245710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27baa8-c2b4-4ff8-98bb-f3671a0f6f25 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:32.264313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 47/92] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:32.265503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849bbd3-5cf6-4c31-8090-8560ab0ab392 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.265821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849bbd3-5cf6-4c31-8090-8560ab0ab392 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.266095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849bbd3-5cf6-4c31-8090-8560ab0ab392 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.267474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 48/93] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:32.268722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f96e5-be8f-48f8-98d1-efe348b7abd8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.269003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f96e5-be8f-48f8-98d1-efe348b7abd8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.269277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f96e5-be8f-48f8-98d1-efe348b7abd8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.274929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 49/94] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:32.279239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.279239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.279239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.299556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2154f0e-7018-4497-bb9e-53092e126b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:32.300176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154f0e-7018-4497-bb9e-53092e126b91 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.300462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154f0e-7018-4497-bb9e-53092e126b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.300740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2154f0e-7018-4497-bb9e-53092e126b91 None admin] PATH_INFO: `/v3/users/395a2fc08e264060911329b9f2474d01` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.301941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2154f0e-7018-4497-bb9e-53092e126b91 None admin] RBAC: Authorizing `identity:get_user(user_id=395a2fc08e264060911329b9f2474d01)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:32.302450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:32.303383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2154f0e-7018-4497-bb9e-53092e126b91 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:32.304090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:32.305780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 46/95] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:32 2022] GET /identity/v3/users/395a2fc08e264060911329b9f2474d01 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:32.306788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.307078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.307355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.328885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:32.330107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:32.349242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:32.419111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 47/96] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:32.422359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:32.427522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 50/97] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:32.497405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:32.544607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3b093-abe3-491e-851f-921ae352e5d5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:32.592659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:32.593660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.594145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.594615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.683320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:32.685122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:32.720437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:32.811020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:32.873512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 48/98] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:32.874415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:32.886363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948c5b4-734a-406d-8599-736bba0b177d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:32.924059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:32.924806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:32.925086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:32.925356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:32.936553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:32.941863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:32.942672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 51/99] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:32.943830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:32.977572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.009268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb9534-58f5-4451-9e25-1bc45b7479c7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.048796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1ee48-92a9-4bbe-a130-7ecdbe032ac1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.055133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.055851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.056200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.057059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.071725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:33.078881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:33.080174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:33.080901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:33.081977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 49/100] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:33.081977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.090276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.091100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.091459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.091814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.103229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:33.108378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:33.109273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:33.110027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 52/101] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:33.110631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.126716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.216418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02368a-1cad-404f-87dc-d13fb4477087 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.236554 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.247052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d035b-95fe-4529-8289-88bf10d4c48d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.262346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.262981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.263264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.263540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.264677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.266180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.267825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 50/102] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.272920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.291182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.291795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.292075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.292352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.293018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:33.293325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.294763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.303712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 53/103] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.304416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.377383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.385620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbbf0e-740d-4980-a1e2-442973368e02 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.405530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7688f1-c615-48f6-b45b-2c0034089ae7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.421144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.421776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.422056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.422552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.422985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:33.423287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.424657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2097c19-32d4-497e-8c9a-34614b548069 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.438639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 51/104] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.438639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6af93-0707-4e65-9a1a-90fc1e327e12 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.438639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6af93-0707-4e65-9a1a-90fc1e327e12 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.438639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6af93-0707-4e65-9a1a-90fc1e327e12 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.438639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 52/105] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:33.438639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6af93-0707-4e65-9a1a-90fc1e327e12 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.445124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.446323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.446606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.446879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.447545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:33.447852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.449232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.458121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 54/106] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.462683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.478811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.551198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6af93-0707-4e65-9a1a-90fc1e327e12 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.573572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ac845-f370-4f8c-a3a5-6028ace31e30 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.587877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.588527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.588770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.589059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.589809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=5152f238881e4a83b5506e208ad7f86f, user.id=395a2fc08e264060911329b9f2474d01) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:33.590140 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.591551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.600055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 53/107] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/role_assignments?user.id=395a2fc08e264060911329b9f2474d01&scope.project.id=5152f238881e4a83b5506e208ad7f86f&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.609882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.618830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05f039-20b5-4891-b0c7-c1403b02f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.619488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05f039-20b5-4891-b0c7-c1403b02f45e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.619768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05f039-20b5-4891-b0c7-c1403b02f45e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.620172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05f039-20b5-4891-b0c7-c1403b02f45e None admin] PATH_INFO: `/v3/users/f92a7df2f1e64a229f21b941d7cd789e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.621364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05f039-20b5-4891-b0c7-c1403b02f45e None admin] RBAC: Authorizing `identity:get_user(user_id=f92a7df2f1e64a229f21b941d7cd789e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.623030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05f039-20b5-4891-b0c7-c1403b02f45e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.625283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 55/108] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/users/f92a7df2f1e64a229f21b941d7cd789e => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.631325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.631552 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.631798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.636825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.653371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:33.660989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:33.725568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749a24-b080-48f2-a2df-dea0c60ad6fe None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.741571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 56/109] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:33.741571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.755989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.778316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.779068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.779422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.779772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] PATH_INFO: `/v3/users/f92a7df2f1e64a229f21b941d7cd789e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.781089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] RBAC: Authorizing `identity:get_user(user_id=f92a7df2f1e64a229f21b941d7cd789e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.782686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.784364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 54/110] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/users/f92a7df2f1e64a229f21b941d7cd789e => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.785281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.862001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100e183-57b6-48b3-bb2f-ba6c3b893590 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.900933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:33.904396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c00b56-cc9a-47c6-b3a0-cc085593db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.905036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c00b56-cc9a-47c6-b3a0-cc085593db45 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.905318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c00b56-cc9a-47c6-b3a0-cc085593db45 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.905617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c00b56-cc9a-47c6-b3a0-cc085593db45 None admin] PATH_INFO: `/v3/users/f92a7df2f1e64a229f21b941d7cd789e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.906751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c00b56-cc9a-47c6-b3a0-cc085593db45 None admin] RBAC: Authorizing `identity:get_user(user_id=f92a7df2f1e64a229f21b941d7cd789e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:33.908209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c00b56-cc9a-47c6-b3a0-cc085593db45 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:33.914725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 57/111] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/users/f92a7df2f1e64a229f21b941d7cd789e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:33.914725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291db460-a4a9-478e-a944-af2873ffa06c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.914725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291db460-a4a9-478e-a944-af2873ffa06c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.914725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291db460-a4a9-478e-a944-af2873ffa06c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:33.914725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 58/112] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:33.914725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291db460-a4a9-478e-a944-af2873ffa06c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:33.918413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066d12-d946-4e5d-b8b9-7481aa43951a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:33.952872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:33.953482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:33.953792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:33.954073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.001803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.022431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291db460-a4a9-478e-a944-af2873ffa06c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.024031 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.025595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.057360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecd196-dd1c-4f8d-acd9-3774c826affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.057999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecd196-dd1c-4f8d-acd9-3774c826affd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.058284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecd196-dd1c-4f8d-acd9-3774c826affd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.058570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecd196-dd1c-4f8d-acd9-3774c826affd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.109301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.121341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 55/113] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:34.122580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.128232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecd196-dd1c-4f8d-acd9-3774c826affd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.129735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecd196-dd1c-4f8d-acd9-3774c826affd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.206292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.219451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce199e-10d8-45b7-877a-c4406fd2026c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.228690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 59/114] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:34.230401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.230695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.230970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.248937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:34.250228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:34.256101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.256706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.256987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.257263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.310870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.315040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 60/115] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:34.318465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.323331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.324832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.420449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef888ab-f5cf-40b5-bd0d-4ab73662af21 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.426646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 56/116] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:34.427737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.435106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.460665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.461790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.462071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.462341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.472760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:34.478040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:34.478871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:34.479594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 61/117] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:34.480202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.526434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.541283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcd286-d46d-4d83-ab1f-ff60bd7293dd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.575224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.575952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.576233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.576507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.577649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.579078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.581007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 57/118] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.581785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.586646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbccf01-f6be-491c-8c30-4ad5e871352a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.618606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.619226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.619508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.619786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] PATH_INFO: `/v3/projects/b8264c92d82b46b2a846307145a484f5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.620912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] RBAC: Authorizing `identity:get_project(project_id=b8264c92d82b46b2a846307145a484f5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.622401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.624010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 62/119] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/projects/b8264c92d82b46b2a846307145a484f5 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.624761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.664936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.681848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4f22-1446-44f6-accb-395cabcde7cf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.715739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce6578-0034-4479-9385-49400a029022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.716447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce6578-0034-4479-9385-49400a029022 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.716732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce6578-0034-4479-9385-49400a029022 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.717014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce6578-0034-4479-9385-49400a029022 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.718157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce6578-0034-4479-9385-49400a029022 None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.719619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce6578-0034-4479-9385-49400a029022 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.721232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 58/120] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.726197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce6578-0034-4479-9385-49400a029022 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.726308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2933b8-81ee-4684-91fc-674d7e971cbc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.749685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.756386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.757020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.757307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.759940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.759940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:34.759940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.760486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.768623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 63/121] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.769570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.825566 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce6578-0034-4479-9385-49400a029022 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.858236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.858864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.859150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.859432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.860539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.862029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.862349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.863598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 59/122] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.864362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.865594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f6ad-d889-433b-8078-c5aa93d4f2fb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:34.899937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:34.900509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:34.900789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:34.901061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:34.901810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] RBAC: Adding query filter params (role.id=e275c993797f4c7eb8ee1081d5088b3a, scope.project.id=5152f238881e4a83b5506e208ad7f86f, user.id=f92a7df2f1e64a229f21b941d7cd789e) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:34.902116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:34.903532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:34.909078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 64/123] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/role_assignments?user.id=f92a7df2f1e64a229f21b941d7cd789e&scope.project.id=5152f238881e4a83b5506e208ad7f86f&role.id=e275c993797f4c7eb8ee1081d5088b3a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:34.909874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:34.961163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:34.970971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81558819-d191-4d2f-a8f2-bcb69713e87c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.008912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.009710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.009999 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.010290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.011021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] RBAC: Adding query filter params (role.id=87acec30d5ae421e8ff804046c98950a, scope.project.id=b8264c92d82b46b2a846307145a484f5, user.id=f92a7df2f1e64a229f21b941d7cd789e) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:35.011336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.012856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.020229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 60/124] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/role_assignments?user.id=f92a7df2f1e64a229f21b941d7cd789e&scope.project.id=b8264c92d82b46b2a846307145a484f5&role.id=87acec30d5ae421e8ff804046c98950a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:35.021010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.029991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8896eec-8ec1-483f-9a52-16d40b11ead7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.087965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.088913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.089334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.089810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.090692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] RBAC: Adding query filter params (role.id=87acec30d5ae421e8ff804046c98950a, scope.project.id=5152f238881e4a83b5506e208ad7f86f, user.id=f92a7df2f1e64a229f21b941d7cd789e) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:35.091144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.093918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.103735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 65/125] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:34 2022] GET /identity/v3/role_assignments?user.id=f92a7df2f1e64a229f21b941d7cd789e&scope.project.id=5152f238881e4a83b5506e208ad7f86f&role.id=87acec30d5ae421e8ff804046c98950a => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:35.105323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.144441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.167895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0e068-9fe2-462a-b5c3-955cfd75c538 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.230509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.231124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.231471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.231810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] PATH_INFO: `/v3/users/42888968bf544ffa9ff1aa3abf30264a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.241814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dce344-bd49-4f80-b485-33f68cca3e58 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.254163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] RBAC: Authorizing `identity:get_user(user_id=42888968bf544ffa9ff1aa3abf30264a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.255822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.259072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 61/126] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:35 2022] GET /identity/v3/users/42888968bf544ffa9ff1aa3abf30264a => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:35.265504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.286930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.295510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.303304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.303304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.303304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.303304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.303304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.383227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e02d-18b9-431a-afd3-23206b7cc954 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.383418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 66/127] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:24:35 2022] POST /identity/v3/projects => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:35.421919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1936e9-a239-435e-88a4-458d7105ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.422572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1936e9-a239-435e-88a4-458d7105ba15 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.422852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1936e9-a239-435e-88a4-458d7105ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.423127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1936e9-a239-435e-88a4-458d7105ba15 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.424315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1936e9-a239-435e-88a4-458d7105ba15 None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.425800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1936e9-a239-435e-88a4-458d7105ba15 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.427469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 62/128] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:35 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:35.433739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:35.520403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:35.540717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7696a55-35d1-40d8-b448-252627f48c00 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:35.576685 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99977e2-3756-4490-bc15-f1d9f894c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:35.577352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99977e2-3756-4490-bc15-f1d9f894c3ad None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:35.577715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99977e2-3756-4490-bc15-f1d9f894c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:35.578052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99977e2-3756-4490-bc15-f1d9f894c3ad None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/42888968bf544ffa9ff1aa3abf30264a/roles/61efc5b63c524de98263a5662cf6ddb1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:35.579990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99977e2-3756-4490-bc15-f1d9f894c3ad None admin] RBAC: Authorizing `identity:create_grant(project_id=5152f238881e4a83b5506e208ad7f86f, user_id=42888968bf544ffa9ff1aa3abf30264a, role_id=61efc5b63c524de98263a5662cf6ddb1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:35.581446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99977e2-3756-4490-bc15-f1d9f894c3ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:35.633295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 67/129] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:35 2022] PUT /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f/users/42888968bf544ffa9ff1aa3abf30264a/roles/61efc5b63c524de98263a5662cf6ddb1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:37.547382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942a5d-ad9a-49f9-a952-d4a78cdbcfff None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:37.547863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942a5d-ad9a-49f9-a952-d4a78cdbcfff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:37.547863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74942a5d-ad9a-49f9-a952-d4a78cdbcfff None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:37.549190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 63/130] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:37.554578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d549d-95b1-4628-a923-97bf51a2fb16 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:37.554990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d549d-95b1-4628-a923-97bf51a2fb16 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:37.555136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d549d-95b1-4628-a923-97bf51a2fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:37.573171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d73d549d-95b1-4628-a923-97bf51a2fb16 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:37.574385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d73d549d-95b1-4628-a923-97bf51a2fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:37.640520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 68/131] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:37.743582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ea78-41fa-4ee8-b23f-6b614868882e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:37.743868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ea78-41fa-4ee8-b23f-6b614868882e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:37.744146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ea78-41fa-4ee8-b23f-6b614868882e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:37.745499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 64/132] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:37.750744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:37.753600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:37.753600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:37.769905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:37.771067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:37.830734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:37.834921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 69/133] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:37.911337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887ea78-41fa-4ee8-b23f-6b614868882e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:37.992818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:38.011111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887ea78-41fa-4ee8-b23f-6b614868882e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:38.044187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:38.044814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:38.045094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:38.045367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:38.046478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:38.047916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:38.049454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 65/134] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:38.055455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:38.098778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:38.151546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5a3ec-c7ca-4dbd-b84e-c6989d747cbe None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:38.184825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:38.185426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:38.185740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:38.186015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:38.186674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:38.188102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:38.197466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135df9a9-d445-4ff7-a466-6e7dc893b9a8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:38.230912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:38.231541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:38.231879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:38.232158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:38.242809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:38.247723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:38.248690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:38.249713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 66/135] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:38.254611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:38.266289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:38.284161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 70/136] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:38 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:38.358829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d662a1-b02d-434e-93bd-9c9e11819382 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:38.394453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:38.395082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:38.395366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:38.395642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:38.396321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:38.396637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:38.398660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:38.407593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 67/137] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:38.413506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:38.473300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:38.517455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a84452-8da8-430b-b157-86d9ff407423 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:38.554189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:38.554865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:38.555373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:38.555477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] PATH_INFO: `/v3/users/42888968bf544ffa9ff1aa3abf30264a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:38.556546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] RBAC: Authorizing `identity:get_user(user_id=42888968bf544ffa9ff1aa3abf30264a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:38.558026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:38.559617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 71/138] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:38 2022] GET /identity/v3/users/42888968bf544ffa9ff1aa3abf30264a => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:38.565348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:38.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:38.670583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831da9a-fcfb-420e-986d-0539bdb35c27 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:38.707275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:38.707893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:38.708177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:38.708456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:38.781356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:38.782858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:38.854964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:38.885199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 68/139] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:38.891154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:38.994084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752b144-9f54-494a-8b6d-119a1650906b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:39.018921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:39.030249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666823be-5954-48b2-9fa8-9bd5cdfa9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:39.030886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666823be-5954-48b2-9fa8-9bd5cdfa9604 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:39.031166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666823be-5954-48b2-9fa8-9bd5cdfa9604 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:39.031444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666823be-5954-48b2-9fa8-9bd5cdfa9604 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:39.032624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666823be-5954-48b2-9fa8-9bd5cdfa9604 None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:39.034115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666823be-5954-48b2-9fa8-9bd5cdfa9604 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:39.035846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 72/140] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:38 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:39.041530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:39.148136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8218a-bcf8-4768-9147-f02e83a3aaae None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:39.184355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:39.185263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:39.185742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:39.186185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:39.187098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] RBAC: Adding query filter params (role.id=61efc5b63c524de98263a5662cf6ddb1, scope.project.id=5152f238881e4a83b5506e208ad7f86f, user.id=42888968bf544ffa9ff1aa3abf30264a) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:39.187574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:39.189176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc27fe-97ea-41f7-b6c6-336dc47845b5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:39.196549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 69/141] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:39 2022] GET /identity/v3/role_assignments?user.id=42888968bf544ffa9ff1aa3abf30264a&scope.project.id=5152f238881e4a83b5506e208ad7f86f&role.id=61efc5b63c524de98263a5662cf6ddb1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:40.550060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26dd53-bf89-4f4d-aafd-b6a3d4b33d73 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:40.550536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26dd53-bf89-4f4d-aafd-b6a3d4b33d73 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:40.550536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26dd53-bf89-4f4d-aafd-b6a3d4b33d73 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:40.552022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 73/142] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:40.557169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23951-83ba-4047-a6c8-644cc4116abb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:40.557668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23951-83ba-4047-a6c8-644cc4116abb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:40.557739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23951-83ba-4047-a6c8-644cc4116abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:40.577597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-99d23951-83ba-4047-a6c8-644cc4116abb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:40.578824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-99d23951-83ba-4047-a6c8-644cc4116abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:40.610997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:40.649603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 70/143] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:40.684021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61466b2f-d279-4521-a944-0c1886f0228d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:40.684309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61466b2f-d279-4521-a944-0c1886f0228d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:40.684590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61466b2f-d279-4521-a944-0c1886f0228d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:40.686110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 74/144] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:40.691123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973d831-ab05-4603-9086-0e8b426161d1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:40.691416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973d831-ab05-4603-9086-0e8b426161d1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:40.691697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973d831-ab05-4603-9086-0e8b426161d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:40.710619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a973d831-ab05-4603-9086-0e8b426161d1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:40.711835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a973d831-ab05-4603-9086-0e8b426161d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:40.784020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 71/145] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:40.833254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27a40-4106-4ceb-979a-0612ef3845c3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:40.833563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27a40-4106-4ceb-979a-0612ef3845c3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:40.833889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27a40-4106-4ceb-979a-0612ef3845c3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:40.835354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 75/146] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:40.840498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:40.840791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:40.841071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:40.858727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:40.859914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:40.921265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27a40-4106-4ceb-979a-0612ef3845c3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:40.925904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 72/147] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:41.022711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27a40-4106-4ceb-979a-0612ef3845c3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.048984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.056747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.057375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.057683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.057951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.068164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:41.073420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:41.074501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:41.075697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 76/148] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:41.079821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.080088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.134569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.158543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208315-2ee8-4ad7-a0b9-00dd7defda86 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.180567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4a50-85d1-4690-9b74-2381407eccfa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.193052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.193711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.193992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.194294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.204815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:41.209640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:41.210612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:41.211962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 73/149] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:41.216832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.217367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.217996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.218278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.218549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.221822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:41.221822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.221822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.231760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 77/150] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:41.232577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.304833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.319109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d211e-0c90-4450-b410-510a0e828faa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.329447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48c7ae-834c-430b-a944-2e5db4d5a2a7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.343656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.353751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.354369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.354644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.354918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.356003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.357437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.359048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 74/151] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:41.359794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.364652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.365423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.365871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.366145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.366841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:41.367149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.368508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.377139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 78/152] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:41.377781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.462486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a055-cc8f-4b1b-82c3-24775ad026d2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.478694 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc536ae-a22f-403e-8806-fffc0725a580 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.494819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.495433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.495707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.495975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] PATH_INFO: `/v3/users/85e27111eab04e69bf67dfb16ff311cb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.509083 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] RBAC: Authorizing `identity:get_user(user_id=85e27111eab04e69bf67dfb16ff311cb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.510557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.511550 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.512124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 75/153] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/users/85e27111eab04e69bf67dfb16ff311cb => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:41.512273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.512443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.512686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.512872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.513339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.514798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.526872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.605803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1829-bc4b-4540-a7fd-1d5377afa5fb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.622022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 79/154] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:41 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:41.622847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.650477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.651128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.651406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.651677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] PATH_INFO: `/v3/users/85e27111eab04e69bf67dfb16ff311cb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.652868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] RBAC: Authorizing `identity:get_user(user_id=85e27111eab04e69bf67dfb16ff311cb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.654365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.660692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 76/155] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/users/85e27111eab04e69bf67dfb16ff311cb => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:41.661927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.664244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.740688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5fb03-3e84-49e4-88fd-dc4a4e3e55e5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.751636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.775734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307b8d-dfe8-4724-94b3-e49c32105e92 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.780881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.781842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.782306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.782758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.784169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.785998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.787811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 80/156] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:41.794848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.816663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.817304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.817620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.817896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.819452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.821425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.823527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 77/157] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:41 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:41.828889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:41.909024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:41.912108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668acc-ef98-41e6-b446-0da80248118c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.951924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d8acc-9cdd-497f-a85f-61c1d39abd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.952942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8acc-9cdd-497f-a85f-61c1d39abd5d None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.953321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8acc-9cdd-497f-a85f-61c1d39abd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.953742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d8acc-9cdd-497f-a85f-61c1d39abd5d None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/85e27111eab04e69bf67dfb16ff311cb/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:41.956426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d8acc-9cdd-497f-a85f-61c1d39abd5d None admin] RBAC: Authorizing `identity:create_grant(project_id=3f42ad60455344fc9acf9d13733189ee, user_id=85e27111eab04e69bf67dfb16ff311cb, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:41.958578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d8acc-9cdd-497f-a85f-61c1d39abd5d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:41.961676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ab611-d737-4c23-b945-4ffa082c1796 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:41.998533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990abeda-e0b1-4a57-b14a-bfa37a244c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:41.999125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990abeda-e0b1-4a57-b14a-bfa37a244c2e None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:41.999404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990abeda-e0b1-4a57-b14a-bfa37a244c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:41.999678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990abeda-e0b1-4a57-b14a-bfa37a244c2e None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/85e27111eab04e69bf67dfb16ff311cb/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:42.001932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990abeda-e0b1-4a57-b14a-bfa37a244c2e None admin] RBAC: Authorizing `identity:create_grant(project_id=3f42ad60455344fc9acf9d13733189ee, user_id=85e27111eab04e69bf67dfb16ff311cb, role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:42.003382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990abeda-e0b1-4a57-b14a-bfa37a244c2e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:42.015287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 81/158] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:41 2022] PUT /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/85e27111eab04e69bf67dfb16ff311cb/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:24:42.093344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 78/159] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:41 2022] PUT /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/85e27111eab04e69bf67dfb16ff311cb/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:43.909793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba177-f23e-4f21-9011-2bcb2ee5214f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:43.910323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba177-f23e-4f21-9011-2bcb2ee5214f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:43.910557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba177-f23e-4f21-9011-2bcb2ee5214f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:43.912115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 82/160] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:43.917844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263600-ef6e-4296-a675-e1b83169b8a9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:43.918351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263600-ef6e-4296-a675-e1b83169b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:43.918420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263600-ef6e-4296-a675-e1b83169b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:43.938620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-45263600-ef6e-4296-a675-e1b83169b8a9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:43.939823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45263600-ef6e-4296-a675-e1b83169b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:43.942234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:44.010454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 79/161] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:44.036526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd523-6547-4e0b-8cc4-b74003e8c04f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.036875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd523-6547-4e0b-8cc4-b74003e8c04f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.037075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efd523-6547-4e0b-8cc4-b74003e8c04f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.038982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 83/162] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:44.044361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b1b1-ce25-460a-9e18-fed4fe9fd879 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.044654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b1b1-ce25-460a-9e18-fed4fe9fd879 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.044931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b1b1-ce25-460a-9e18-fed4fe9fd879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.063476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ead4b1b1-ce25-460a-9e18-fed4fe9fd879 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:44.064648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ead4b1b1-ce25-460a-9e18-fed4fe9fd879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:44.139663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 80/163] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:44.208542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4f00-2d89-41a8-b4f5-8ebb8a9d4461 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.208816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4f00-2d89-41a8-b4f5-8ebb8a9d4461 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.209003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4f00-2d89-41a8-b4f5-8ebb8a9d4461 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.210456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 84/164] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:44.216413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.216695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.216965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.235370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:44.236547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:44.261297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d0a0f-2d07-42df-905b-33bc9a701002 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.261616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d0a0f-2d07-42df-905b-33bc9a701002 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.261891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d0a0f-2d07-42df-905b-33bc9a701002 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.263232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 85/165] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:44.268448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.268723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.268992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.288067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:44.289287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:44.306756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:44.313425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 81/166] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:44.314878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.369376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 86/167] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:44.426685 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.430530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096efdd6-85ae-43da-a967-79ae5be467e4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:44.478615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:44.479177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.479454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.479720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.493606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:44.499778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:44.500610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:44.501642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 82/168] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:44.507296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.533518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659a10-c359-4bd8-b39c-84ca2f2724ab None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:44.553755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:44.568814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:44.569825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.570781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.571262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.572589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:44.575984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:44.577896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:44.581714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 87/169] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:44.583847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.615521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121016-d70f-4953-9b07-08861bd208c6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:44.652090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:44.652705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.652982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.653254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.653946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:44.654248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:44.655622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:44.663489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 83/170] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:44.665339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.685686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec9f0-7ad6-42f2-ba5f-fa509d16276d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:44.719709 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:44.720360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.720639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.720911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.721661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:44.723209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:44.762743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0dc3e-b141-4188-a71f-f2fc65f5aa0c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:44.781282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:44.794842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:44.795456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.795730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.795999 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.806637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:44.811409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:44.812287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:44.813070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 84/171] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:44.813744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.907534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a8dc9-f9de-4a66-bfc7-ece9feff9802 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:44.924307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 88/172] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:44 2022] POST /identity/v3/users => generated 297 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:44.925134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:44.944012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:44.953977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:44.954735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:44.955055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:44.955357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:44.967902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:44.973578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:44.980959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 85/173] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:44.981759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.028338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.046760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9dde-c50f-4b7a-aa1c-97f9ea5223dc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.085022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.085743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.086024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.086310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] PATH_INFO: `/v3/users/7f2fc8e5560b437d8833597b8b215e36` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.091477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72820b3-9072-48db-98bb-7cbc79c65731 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.103510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] RBAC: Authorizing `identity:get_user(user_id=7f2fc8e5560b437d8833597b8b215e36)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.105296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.107497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 89/174] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/users/7f2fc8e5560b437d8833597b8b215e36 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:45.108853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.132803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.133415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.133727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.134005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.134928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:45.135027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.136357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.144878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 86/175] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:45.149682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.190499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.232680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03682c46-48e2-4588-9bec-12aa22740e59 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.273495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.274133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.275007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.275007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.275438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:45.275708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.277006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.279415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0114-e822-45a9-94e3-ef788f545963 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.281122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.288216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 90/176] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:45.289785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.326489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.327423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.327909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.328392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.330425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.332315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.334704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 87/177] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:45.336237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.429217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f34bb-bdab-4753-b5a1-364fb58c5892 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.447585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28d81-085e-47ad-8c8b-563462232f98 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.477684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.479351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.480181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.480743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] PATH_INFO: `/v3/users/85e27111eab04e69bf67dfb16ff311cb` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.482119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] RBAC: Authorizing `identity:get_user(user_id=85e27111eab04e69bf67dfb16ff311cb)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.483843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.484202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.484476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.484754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.485026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] PATH_INFO: `/v3/users/85e27111eab04e69bf67dfb16ff311cb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.486178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] RBAC: Authorizing `identity:get_user(user_id=85e27111eab04e69bf67dfb16ff311cb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.486998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 91/178] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/users/85e27111eab04e69bf67dfb16ff311cb => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:45.488000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.492973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.494328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 88/179] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/users/85e27111eab04e69bf67dfb16ff311cb => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:45.495898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.548519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.611056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aa676-d88e-4696-b4d9-a7aee8bd07d2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.625747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc588cad-8a46-4dfd-8e74-32fe0a69ac24 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:45.645793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.646383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.646663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.646938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.670826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:45.671977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:45.672873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:45.673639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/7f2fc8e5560b437d8833597b8b215e36/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:45.676620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] RBAC: Authorizing `identity:create_grant(project_id=3f42ad60455344fc9acf9d13733189ee, user_id=7f2fc8e5560b437d8833597b8b215e36, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.679767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.715614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:45.717099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:45.756967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:45.790117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 92/180] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:45 2022] PUT /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/7f2fc8e5560b437d8833597b8b215e36/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:45.791686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.873261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:45.879133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:45.926576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:46.005817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d839-2410-4ad3-8b54-cba9a448572a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:46.054190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:46.054844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:46.055126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:46.055398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:46.067151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4fa8d-efbc-49fd-a602-c5edbf2edf54 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:46.108630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:46.110126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:46.110709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:46.111203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:46.112513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:46.114254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:46.116063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 90/182] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:46.122814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:46.132351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:46.136273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:46.137811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:46.199342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:46.242369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 93/183] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:46.243143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971352c2-3526-490c-8123-b9d4e1066c98 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:46.247844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:46.279976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:46.280925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:46.281425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:46.281954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:46.282877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=3f42ad60455344fc9acf9d13733189ee, user.id=85e27111eab04e69bf67dfb16ff311cb) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:46.283384 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:46.285091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:46.292153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 91/184] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:46 2022] GET /identity/v3/role_assignments?user.id=85e27111eab04e69bf67dfb16ff311cb&scope.project.id=3f42ad60455344fc9acf9d13733189ee&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:46.452649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3148e7-244b-4f2e-8733-2fbffe539aec None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:46.492342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f985291-efd4-4dc1-9c61-5a1d19e80b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:46.492972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985291-efd4-4dc1-9c61-5a1d19e80b38 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:46.493251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985291-efd4-4dc1-9c61-5a1d19e80b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:46.493518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f985291-efd4-4dc1-9c61-5a1d19e80b38 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:46.494774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f985291-efd4-4dc1-9c61-5a1d19e80b38 None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:46.496226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f985291-efd4-4dc1-9c61-5a1d19e80b38 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:46.497882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 94/185] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:46 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:46.503732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:46.599395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:46.632990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4ddb6-4206-4a9b-9256-dc5d9e847ae6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:46.669359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:46.670001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:46.670281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:46.670555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:46.671284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] RBAC: Adding query filter params (role.id=e275c993797f4c7eb8ee1081d5088b3a, scope.project.id=3f42ad60455344fc9acf9d13733189ee, user.id=85e27111eab04e69bf67dfb16ff311cb) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:46.671592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:46.673029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44f614-3825-41aa-8fe2-e72958b3fbcd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:46.679950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 92/186] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:46 2022] GET /identity/v3/role_assignments?user.id=85e27111eab04e69bf67dfb16ff311cb&scope.project.id=3f42ad60455344fc9acf9d13733189ee&role.id=e275c993797f4c7eb8ee1081d5088b3a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:47.307747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc2c8-51ce-4654-9f2c-c1c4cc29eee2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.308296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc2c8-51ce-4654-9f2c-c1c4cc29eee2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.308296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bc2c8-51ce-4654-9f2c-c1c4cc29eee2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.309815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 95/187] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:47.315432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035381-fa06-41a4-a90a-8dea22b73d39 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.315849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035381-fa06-41a4-a90a-8dea22b73d39 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.315986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035381-fa06-41a4-a90a-8dea22b73d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.335300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d9035381-fa06-41a4-a90a-8dea22b73d39 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:47.336532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d9035381-fa06-41a4-a90a-8dea22b73d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:47.408036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 93/188] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:47.449787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c39ed-01ef-4ba1-b8e6-65b398c94b11 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.450066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c39ed-01ef-4ba1-b8e6-65b398c94b11 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.450519 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c39ed-01ef-4ba1-b8e6-65b398c94b11 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.451874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 96/189] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:47.457172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.457463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.457772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.475881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:47.477524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:47.535743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:47.544312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 94/190] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:47.676721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c39ed-01ef-4ba1-b8e6-65b398c94b11 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:47.707046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:47.780333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c39ed-01ef-4ba1-b8e6-65b398c94b11 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:47.808752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:47.815486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:47.816126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.816839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.817119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.828601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:47.833486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:47.834416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:47.835206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 97/191] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:47.842340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:47.914446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef4d8-8775-4e4d-a4ee-a8519b5b1b39 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:47.937369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:47.947501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a10c58-0016-43fe-bbf3-c1ff7455001c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:47.952697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:47.953330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.953631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.953902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.955422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:47.957243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:47.961687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 95/192] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:47.965249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:47.987469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:47.988238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:47.988520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:47.988796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:47.989465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:47.989810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:47.991205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:47.999608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 98/193] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:48.004807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:48.029947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:48.070424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809138d-412f-4fb0-8416-9debcbbcc6c1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:48.106650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b67e9-89ba-4c99-8283-0e44853242d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:48.107876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b67e9-89ba-4c99-8283-0e44853242d8 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.108164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b67e9-89ba-4c99-8283-0e44853242d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.108493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b67e9-89ba-4c99-8283-0e44853242d8 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.109146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b67e9-89ba-4c99-8283-0e44853242d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:48.109804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0bdc-0803-4d1d-82ee-cd4e0186fbd6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:48.110640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b67e9-89ba-4c99-8283-0e44853242d8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:48.143966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:48.144588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.144866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.145135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] PATH_INFO: `/v3/users/0b79a1bd65ee464e96e3a724a966a2a9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.158643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] RBAC: Authorizing `identity:get_user(user_id=0b79a1bd65ee464e96e3a724a966a2a9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:48.160096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:48.161727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 99/194] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:48 2022] GET /identity/v3/users/0b79a1bd65ee464e96e3a724a966a2a9 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:48.164450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 96/195] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:47 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:48.167474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:48.185070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:48.289823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3832-9079-48c3-841c-633f69cf9f42 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:48.319154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca74277-b576-4d8d-adf4-e2aa096fa722 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.320252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca74277-b576-4d8d-adf4-e2aa096fa722 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.320344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca74277-b576-4d8d-adf4-e2aa096fa722 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.321756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 97/196] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:48.327279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.327576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.327836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.332216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:48.332948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.333149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.333426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.334633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:48.336131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:48.337861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 100/197] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:48 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:48.343536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:48.347635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:48.348825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:48.428682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:48.430394 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 98/198] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:48.451772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39886ea-29a0-4ca3-ad13-74bff4eda806 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:48.488558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:48.489287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.489611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.489893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/0b79a1bd65ee464e96e3a724a966a2a9/roles/61efc5b63c524de98263a5662cf6ddb1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.492347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f42ad60455344fc9acf9d13733189ee, user_id=0b79a1bd65ee464e96e3a724a966a2a9, role_id=61efc5b63c524de98263a5662cf6ddb1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:48.493915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:48.565576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 101/199] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:48 2022] PUT /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee/users/0b79a1bd65ee464e96e3a724a966a2a9/roles/61efc5b63c524de98263a5662cf6ddb1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:24:48.697082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:48.784007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:48.838693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a67ae5-8fc9-4701-be18-30394717961d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:48.874731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:48.875363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:48.875642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:48.875916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:48.886588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:48.891651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:48.892669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:48.893904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 99/200] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:48.902586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:49.009700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b73846-3bd1-4174-ab3e-a44219c85eb4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:49.046241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:49.046863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:49.047145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:49.047424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:49.048098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:49.048406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:49.049827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:49.055681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:49.059998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 102/201] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:49.065856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:49.172944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fdc3-3573-4469-86d3-eebe3a283385 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:49.182653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:49.206961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:49.207593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:49.207867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:49.208134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] PATH_INFO: `/v3/users/7f2fc8e5560b437d8833597b8b215e36` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:49.209353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] RBAC: Authorizing `identity:get_user(user_id=7f2fc8e5560b437d8833597b8b215e36)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:49.211395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:49.213381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 100/202] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:49 2022] GET /identity/v3/users/7f2fc8e5560b437d8833597b8b215e36 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:49.218771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:49.326970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9bd7d-085b-4940-a308-e1e9800ca740 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:49.360665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:49.361281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:49.361535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:49.361825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:49.427493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:49.430177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:49.431560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:49.535859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 103/203] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:49.542643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:49.649122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a32145-ad45-4c75-bbcb-d102281d91cb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:49.683800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de6847-3710-4efc-a92c-ffce9e97452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:49.684427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de6847-3710-4efc-a92c-ffce9e97452c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:49.684704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de6847-3710-4efc-a92c-ffce9e97452c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:49.684977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de6847-3710-4efc-a92c-ffce9e97452c None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:49.686126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de6847-3710-4efc-a92c-ffce9e97452c None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:49.687564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de6847-3710-4efc-a92c-ffce9e97452c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:49.689182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 101/204] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:49 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:49.695858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:49.796971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:49.800788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694125c8-4431-40b9-be0a-fd5a1229d494 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:49.842858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:49.843467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:49.843748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:49.844017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:49.844737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] RBAC: Adding query filter params (role.id=87acec30d5ae421e8ff804046c98950a, scope.project.id=3f42ad60455344fc9acf9d13733189ee, user.id=7f2fc8e5560b437d8833597b8b215e36) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:49.845038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:49.846598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc207-bac2-4636-815e-557550c4a6a4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:49.852483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 104/205] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:49 2022] GET /identity/v3/role_assignments?user.id=7f2fc8e5560b437d8833597b8b215e36&scope.project.id=3f42ad60455344fc9acf9d13733189ee&role.id=87acec30d5ae421e8ff804046c98950a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:50.526968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241cc23-8cb7-4849-84f5-7d9c66b60a12 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.527310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241cc23-8cb7-4849-84f5-7d9c66b60a12 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.527490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241cc23-8cb7-4849-84f5-7d9c66b60a12 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.528960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 102/206] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:50.533918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.534346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.534499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.552917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:50.554146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:50.586657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c472-9236-487a-84bd-8e59e3865a18 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.587175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c472-9236-487a-84bd-8e59e3865a18 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.587285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c472-9236-487a-84bd-8e59e3865a18 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.588771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 103/207] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:50.593759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233ac8-fd68-4f23-a518-299344fecbbc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.594046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233ac8-fd68-4f23-a518-299344fecbbc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.594322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233ac8-fd68-4f23-a518-299344fecbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.613260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fb233ac8-fd68-4f23-a518-299344fecbbc None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:50.614317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb233ac8-fd68-4f23-a518-299344fecbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:50.625088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 105/208] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:50.655777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:50.681849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 104/209] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:50.890324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:50.896052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f7865-3873-43d7-af13-1f48d14a6dd0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.896330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f7865-3873-43d7-af13-1f48d14a6dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.896607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f7865-3873-43d7-af13-1f48d14a6dd0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.898779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 105/210] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:50.903614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.903897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.904166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.922772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:50.924170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:50.982453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:50.988448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324540-3a38-4f8b-ab5c-81de86817dba None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:50.992557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 106/211] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:50.993557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.023834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.024470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.024750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.025023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.035635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:51.040724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:51.041846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:51.042712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 106/212] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:51.047462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.098719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba4d3-3118-4a15-8777-b5e993f44f25 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.101466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:51.138345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.138977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.139254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.139526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.140675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.142278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.144362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 107/213] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:51.150131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.154887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecd79-3f92-43d9-b12d-811f70f9cfbd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.190636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.191332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.191686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.192033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.192760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:51.193225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.195203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.203410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 107/214] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:51.208716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.229840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:51.261642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24d612-84a5-493b-9bb7-8987ee304ab0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.294926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.295526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.295798 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.296066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.296713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.298173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.310990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c40c-e5e1-46f0-8a67-8a675737e218 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.344728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.345350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.345667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.345943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] PATH_INFO: `/v3/users/e92dec9433644029baf8488ac0778179` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.358840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e92dec9433644029baf8488ac0778179)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.360337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.361989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 108/215] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/users/e92dec9433644029baf8488ac0778179 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:51.363837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.387586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 108/216] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:51 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:51.388399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.419712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:51.458843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:51.485571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a7af-71bb-4d91-aa17-80c373aa23f6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.504354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257b8ea-6920-4c14-8884-7d8ca514facb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.523631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.524576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.524907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.525379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.538998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:51.543980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:51.544850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:51.546412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 109/217] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:51.547236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.547753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.548031 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.548303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.549044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] RBAC: Adding query filter params (role.id=87acec30d5ae421e8ff804046c98950a, user.id=e92dec9433644029baf8488ac0778179, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:51.549351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.550947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.551053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.557685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 109/218] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/role_assignments?user.id=e92dec9433644029baf8488ac0778179&scope.system=all&role.id=87acec30d5ae421e8ff804046c98950a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:51.668688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509af4d-58e1-4878-83c7-f17be787fc01 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.707951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.709317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.709317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.709317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.709837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:51.710170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.711580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.713294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:51.722883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 110/219] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:51.729285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.825198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:51.834783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f38bd2-aeb6-41f2-8a45-328f5d939eb1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.870375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.871014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.871348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.871623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] PATH_INFO: `/v3/users/0b79a1bd65ee464e96e3a724a966a2a9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.872789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] RBAC: Authorizing `identity:get_user(user_id=0b79a1bd65ee464e96e3a724a966a2a9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.874305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.875883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 110/220] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/users/0b79a1bd65ee464e96e3a724a966a2a9 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:51.881574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.985992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2f3d1-af94-415d-882f-5551baa6e68a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:52.021622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:52.022237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:52.023038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:52.023318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:52.086072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:52.092567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:52.094092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:52.193720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 111/221] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:52.199410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:52.310544 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234934a-101f-4b33-9b81-77cfe767172f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:52.346181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81859ecc-4764-46bb-8b6e-04f63b65c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:52.347055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859ecc-4764-46bb-8b6e-04f63b65c77f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:52.347505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859ecc-4764-46bb-8b6e-04f63b65c77f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:52.347926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859ecc-4764-46bb-8b6e-04f63b65c77f None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:52.349204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81859ecc-4764-46bb-8b6e-04f63b65c77f None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:52.350876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81859ecc-4764-46bb-8b6e-04f63b65c77f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:52.352973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 111/222] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:52 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:52.358765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:52.457416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:52.463870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6ceca-d531-4e35-9a8c-289cd0616467 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:52.500216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:52.500834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:52.501117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:52.501385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:52.502143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] RBAC: Adding query filter params (role.id=61efc5b63c524de98263a5662cf6ddb1, scope.project.id=3f42ad60455344fc9acf9d13733189ee, user.id=0b79a1bd65ee464e96e3a724a966a2a9) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:52.502448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:52.503944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddce93-36ea-4162-9f29-91212b85e71f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:52.511141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 112/223] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:52 2022] GET /identity/v3/role_assignments?user.id=0b79a1bd65ee464e96e3a724a966a2a9&scope.project.id=3f42ad60455344fc9acf9d13733189ee&role.id=61efc5b63c524de98263a5662cf6ddb1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:53.739105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9347b-63fb-4ffd-b815-f30a2acd3a2a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:53.739650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9347b-63fb-4ffd-b815-f30a2acd3a2a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:53.739650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9347b-63fb-4ffd-b815-f30a2acd3a2a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:53.741050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 112/224] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:53.746233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81701166-12ae-4554-be6c-4ce39a605fea None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:53.746637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81701166-12ae-4554-be6c-4ce39a605fea None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:53.746799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81701166-12ae-4554-be6c-4ce39a605fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:53.758548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d71867-a453-457a-ae1a-fe5e0f70b839 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:53.758860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d71867-a453-457a-ae1a-fe5e0f70b839 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:53.759103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d71867-a453-457a-ae1a-fe5e0f70b839 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:53.760492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 113/225] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:24:53.766495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4312-59de-46e0-a008-08e6f892b903 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:53.766726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-81701166-12ae-4554-be6c-4ce39a605fea None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:53.766816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4312-59de-46e0-a008-08e6f892b903 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:53.767029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4312-59de-46e0-a008-08e6f892b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:53.768013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-81701166-12ae-4554-be6c-4ce39a605fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:53.786511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-efeb4312-59de-46e0-a008-08e6f892b903 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:53.787718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-efeb4312-59de-46e0-a008-08e6f892b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:53.811334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:53.840854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 113/226] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:53.856684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 114/227] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:53.889221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df07b28-a07c-432c-b10b-24fe786b2818 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:53.889509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df07b28-a07c-432c-b10b-24fe786b2818 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:53.889829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df07b28-a07c-432c-b10b-24fe786b2818 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:53.891312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 114/228] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:53.896478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:53.896768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:53.897049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:53.915973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:53.917158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:53.982265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 115/229] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:54.108301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df07b28-a07c-432c-b10b-24fe786b2818 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.126051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.215719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.223480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.232800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f3008-f643-499b-bd2a-f76dcfb1899c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.234036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df07b28-a07c-432c-b10b-24fe786b2818 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.267967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.268468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.268585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.268860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.269096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.269192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.269376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.269680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.279040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:54.279952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:54.283866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:54.284700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:54.285457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 116/230] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:54.290037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:54.290918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:54.293224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:54.293970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.294081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 115/231] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:54.294081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.382843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b7cf5-a993-47e6-801c-381ef5ff988c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.389348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6f08-82a1-4eeb-90f7-4f8c51ea5e07 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.414660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.415269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.415542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.415807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.416884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.418343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.419905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 117/232] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:54.420647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.423098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.423784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.424127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.424404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.425059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:54.425373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.426769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.435546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 116/233] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:54.436166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.443493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.452156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.522735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd04e7-693f-4973-9085-a5e4c6ee9eeb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.533196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a828-9296-42ff-beab-d525c54dd398 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.555579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.556182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.556459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.556731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.557388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:54.557720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.559086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.565781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.566371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.566648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.566784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 118/234] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:54.567560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.569736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] PATH_INFO: `/v3/groups` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.570388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.571835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.642923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.644020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 117/235] 10.222.0.26 () {60 vars in 1134 bytes} [Wed Nov 2 07:24:54 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:54.644683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.680694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ac114-e046-4ce4-9e7c-d39938324f3c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.716586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.717355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.717588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.717919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] PATH_INFO: `/v3/users/f670155de2e44cfc9775b17462ae1004` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.734445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.812374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] RBAC: Authorizing `identity:get_user(user_id=f670155de2e44cfc9775b17462ae1004)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.814189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.815886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 119/236] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/users/f670155de2e44cfc9775b17462ae1004 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:54.821965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.832068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfb3d7-248a-400f-8208-41f2f60b63ad None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.871352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.872440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.872731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.873288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] PATH_INFO: `/v3/users/e92dec9433644029baf8488ac0778179` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.874536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] RBAC: Authorizing `identity:get_user(user_id=e92dec9433644029baf8488ac0778179)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.876833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.878769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 118/237] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/users/e92dec9433644029baf8488ac0778179 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:54.884193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:54.935410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab894adf-5afb-4a9d-bb90-f87be2454490 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:54.971380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:54.972131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:54.972405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:54.972674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:54.973389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] RBAC: Adding query filter params (role.id=61efc5b63c524de98263a5662cf6ddb1, user.id=f670155de2e44cfc9775b17462ae1004, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:54.973733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:54.975163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b6c6e-c382-4798-ada0-b227f2994fac None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:54.978131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:54.981158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 120/238] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Nov 2 07:24:54 2022] GET /identity/v3/role_assignments?user.id=f670155de2e44cfc9775b17462ae1004&scope.system=all&role.id=61efc5b63c524de98263a5662cf6ddb1 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:54.992205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78cdd0-8bf5-4b5a-89a4-eb136a5b7a3e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:55.031834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114c825-1f8b-49ea-a118-df409138c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:55.032511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114c825-1f8b-49ea-a118-df409138c2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:55.032789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114c825-1f8b-49ea-a118-df409138c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:55.033065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114c825-1f8b-49ea-a118-df409138c2d0 None admin] PATH_INFO: `/v3/system/users/e92dec9433644029baf8488ac0778179/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:55.034712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114c825-1f8b-49ea-a118-df409138c2d0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e92dec9433644029baf8488ac0778179, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:55.036136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114c825-1f8b-49ea-a118-df409138c2d0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:55.096719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 119/239] 10.222.0.26 () {58 vars in 1334 bytes} [Wed Nov 2 07:24:54 2022] PUT /identity/v3/system/users/e92dec9433644029baf8488ac0778179/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:24:56.815896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b82b-19e0-4217-b315-a138c91d6314 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:56.816402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b82b-19e0-4217-b315-a138c91d6314 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:56.816475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82b82b-19e0-4217-b315-a138c91d6314 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:56.817849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 121/240] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:56.823458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4106c9-ee61-4a81-bff9-d0993fc6e310 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:56.823860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4106c9-ee61-4a81-bff9-d0993fc6e310 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:56.824019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4106c9-ee61-4a81-bff9-d0993fc6e310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:56.831876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:56.842460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ad4106c9-ee61-4a81-bff9-d0993fc6e310 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:56.843647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ad4106c9-ee61-4a81-bff9-d0993fc6e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:56.911512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 120/241] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:57.150157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67e07f-70e8-485e-b131-4c7b63b4cad3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.150522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67e07f-70e8-485e-b131-4c7b63b4cad3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.150703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67e07f-70e8-485e-b131-4c7b63b4cad3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.152190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 122/242] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:57.157108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94e9b-0e3a-45dd-9c08-fbddbbe29f80 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.157465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94e9b-0e3a-45dd-9c08-fbddbbe29f80 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.157850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f94e9b-0e3a-45dd-9c08-fbddbbe29f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.175888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c1f94e9b-0e3a-45dd-9c08-fbddbbe29f80 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:57.177151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67e07f-70e8-485e-b131-4c7b63b4cad3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.177276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c1f94e9b-0e3a-45dd-9c08-fbddbbe29f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:57.250793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 121/243] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:24:57.252042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda70f3-b674-47d1-9484-1d90b691ef34 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.252329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda70f3-b674-47d1-9484-1d90b691ef34 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.252605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda70f3-b674-47d1-9484-1d90b691ef34 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.253888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 122/244] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:57.259697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.259980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.260254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.277726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:57.278893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:57.286775 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67e07f-70e8-485e-b131-4c7b63b4cad3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:57.321809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:57.322434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.322709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.322984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.324043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:57.325470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:57.327195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 123/245] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:57.332348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.340806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:57.350144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 123/246] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:24:57.401447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:57.432633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4de8-c9f0-4926-9669-cc020d799467 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:57.465494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:57.466117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.466390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.466656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] PATH_INFO: `/v3/groups` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.467267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:57.468680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:57.522186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.565246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 124/247] 10.222.0.26 () {60 vars in 1134 bytes} [Wed Nov 2 07:24:57 2022] POST /identity/v3/groups => generated 226 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:57.620498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.628072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0621ebe-2e09-4c32-b4ea-bcdbd6b5230d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:57.666496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:57.667058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.667337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.667615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.679457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:57.684455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:57.685350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:24:57.686491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 124/248] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:24:57.691526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.735978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf60980-347e-4c80-9f27-74ce558b843c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:57.754534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:57.765909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:57.774255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:57.775802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.775802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.775802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.793604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:57.798167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:57.799034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:24:57.799821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 125/249] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:57.801933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.805184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a296c9-e758-4687-82a3-62da318214d8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:57.850331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:57.851457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.851719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.851984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.852646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:57.852944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:57.854421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:57.864142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 125/250] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:57.870526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:57.930431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0c39-9bc8-415f-8853-74ba80377bf3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:57.970340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:57.971117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:57.971488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:57.971853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:57.972628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:57.973026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:57.974606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:57.986959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 126/251] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:57.991889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:58.010274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9377e-0618-4cf9-a170-5df447fab05a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:58.030240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:58.053115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:58.054333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:58.054798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:58.055364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] PATH_INFO: `/v3/users/f670155de2e44cfc9775b17462ae1004` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:58.056956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] RBAC: Authorizing `identity:get_user(user_id=f670155de2e44cfc9775b17462ae1004)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:58.059097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:58.059567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:58.061841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 126/252] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/users/f670155de2e44cfc9775b17462ae1004 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:58.067350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:58.113096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca014ab-c57e-4476-9ca9-4b0ec9d7e8a7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:58.159704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:58.160609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:58.161046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:58.161467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] PATH_INFO: `/v3/users/e92dec9433644029baf8488ac0778179` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:58.163920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] RBAC: Authorizing `identity:get_user(user_id=e92dec9433644029baf8488ac0778179)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:58.165873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:58.167938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 127/253] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:57 2022] GET /identity/v3/users/e92dec9433644029baf8488ac0778179 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:58.173997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:58.200216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f802a64-bc1f-4f73-9361-2f5fe0c64ccf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:58.244383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bce501-1f8e-49fd-9e78-7467b314c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:58.245292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bce501-1f8e-49fd-9e78-7467b314c9a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:58.245726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bce501-1f8e-49fd-9e78-7467b314c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:58.246352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bce501-1f8e-49fd-9e78-7467b314c9a5 None admin] PATH_INFO: `/v3/system/users/f670155de2e44cfc9775b17462ae1004/roles/61efc5b63c524de98263a5662cf6ddb1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:58.247711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bce501-1f8e-49fd-9e78-7467b314c9a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f670155de2e44cfc9775b17462ae1004, role_id=61efc5b63c524de98263a5662cf6ddb1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:58.249192 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bce501-1f8e-49fd-9e78-7467b314c9a5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:58.286606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81859cd-60b7-494d-a5b6-3568342eb88c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:58.304875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:58.319861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 127/254] 10.222.0.26 () {58 vars in 1334 bytes} [Wed Nov 2 07:24:58 2022] PUT /identity/v3/system/users/f670155de2e44cfc9775b17462ae1004/roles/61efc5b63c524de98263a5662cf6ddb1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:24:58.323341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:58.324052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:58.324334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:58.324655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:58.325403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] RBAC: Adding query filter params (role.id=87acec30d5ae421e8ff804046c98950a, user.id=e92dec9433644029baf8488ac0778179, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:58.325755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:58.327262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec518e-1646-43bd-8041-97670655db20 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:58.342069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 128/255] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Nov 2 07:24:58 2022] GET /identity/v3/role_assignments?user.id=e92dec9433644029baf8488ac0778179&scope.system=all&role.id=87acec30d5ae421e8ff804046c98950a => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:59.973773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892afa-8f8a-44bb-aa82-7c1cf12226da None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:59.974280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892afa-8f8a-44bb-aa82-7c1cf12226da None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:59.974353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892afa-8f8a-44bb-aa82-7c1cf12226da None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:59.975998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 128/256] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:59.982385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb63798-c157-46e6-b3a9-3bc306b5dae7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:59.982835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb63798-c157-46e6-b3a9-3bc306b5dae7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:59.983020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb63798-c157-46e6-b3a9-3bc306b5dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.003497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3fb63798-c157-46e6-b3a9-3bc306b5dae7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:00.004708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fb63798-c157-46e6-b3a9-3bc306b5dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:00.084051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 129/257] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:25:00.573473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb295d-aeaa-4ea0-974f-b53a8c16ff20 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.573795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb295d-aeaa-4ea0-974f-b53a8c16ff20 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.573990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb295d-aeaa-4ea0-974f-b53a8c16ff20 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.575350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 129/258] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:00.580729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.581027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.581310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.603069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb295d-aeaa-4ea0-974f-b53a8c16ff20 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:00.619344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:00.620543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:00.621978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb295d-aeaa-4ea0-974f-b53a8c16ff20 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:00.630809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:00.631466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.631755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.632030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.641866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 130/259] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:25:00.649018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:00.654004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:00.654838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:00.655595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 130/260] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:00.662006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:00.672315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1240337-9a80-4870-ab62-d48c30a83876 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:00.676856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:00.677531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.677875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.678149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.679545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:00.679855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:00.681679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:25:00.681679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:25:00.681679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:25:00.682583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:00.692435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 131/261] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:00.697775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:00.708938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53570f82-0f09-427b-b348-dac7c74b206a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:00.713579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:00.714232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.714513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.714790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.726383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:00.728253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:25:00.728253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:25:00.728253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:25:00.729665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:00.731389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 131/262] 10.222.0.26 () {56 vars in 1201 bytes} [Wed Nov 2 07:25:00 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:00.736975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:00.748851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df208-923d-4104-a456-bbddfc7f54a1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:00.757430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:00.758197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.758488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.758766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.760045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:00.762208 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:00.764247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 132/263] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Nov 2 07:25:00 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:00.769780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:00.780432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2fae-aa30-46d9-b41b-92582cd3a0b8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:00.785105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:00.785873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:00.786159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:00.786437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f/groups/b84684ec4eb54149ab53992d417dcd28/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:00.789112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152f238881e4a83b5506e208ad7f86f, group_id=b84684ec4eb54149ab53992d417dcd28, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:00.790185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:25:00.790185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:25:00.790185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:25:00.792266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:00.919755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 132/264] 10.222.0.26 () {58 vars in 1463 bytes} [Wed Nov 2 07:25:00 2022] PUT /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f/groups/b84684ec4eb54149ab53992d417dcd28/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:00.991439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:01.002118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca69eb-c6bc-42c1-8116-adf6dcc26d09 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:01.075553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:01.076289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.076577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.076915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.092778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:01.098465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:01.099316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:01.100097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 133/265] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Nov 2 07:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:01.106642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:01.120307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f15157-9e64-4fd2-ac9e-e616e39ae018 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:01.124960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:01.125609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.125895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.126170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.126984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:01.127295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:01.128354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:25:01.128354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:25:01.128354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:25:01.129309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:01.139773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 133/266] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Nov 2 07:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:01.146927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:01.158186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d150e-10a6-4c0c-8da7-5baf02191d0a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:01.163091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:01.163811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.164091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.164367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.165627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:01.166722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:25:01.166722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:25:01.166722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:25:01.168081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:01.169836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 134/267] 10.222.0.26 () {56 vars in 1201 bytes} [Wed Nov 2 07:25:01 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:01.175563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:01.188189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d1b4-6d4d-4920-8de2-6a93860c759f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:01.192954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534927-20b6-451a-a4ba-3a5131cf4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:01.193695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534927-20b6-451a-a4ba-3a5131cf4d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.194051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534927-20b6-451a-a4ba-3a5131cf4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.194858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534927-20b6-451a-a4ba-3a5131cf4d6b admin admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.196093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534927-20b6-451a-a4ba-3a5131cf4d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:01.198321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534927-20b6-451a-a4ba-3a5131cf4d6b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:01.200441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 134/268] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Nov 2 07:25:01 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:01.206897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:01.217451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcbeb2-7a9c-4ed0-b9a8-b66fd26a5bdd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:01.222132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:01.222810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.223147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.223427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f/groups/b84684ec4eb54149ab53992d417dcd28/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.225807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152f238881e4a83b5506e208ad7f86f, group_id=b84684ec4eb54149ab53992d417dcd28, role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:01.226898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:25:01.226898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:25:01.226898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:25:01.229044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6caa8d-cee6-4737-b0e9-0cb05a229115 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:01.303372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 135/269] 10.222.0.26 () {58 vars in 1463 bytes} [Wed Nov 2 07:25:01 2022] PUT /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f/groups/b84684ec4eb54149ab53992d417dcd28/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:01.510053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546c45-c9fa-4760-8be7-89f94be13259 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.510322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546c45-c9fa-4760-8be7-89f94be13259 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.510610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546c45-c9fa-4760-8be7-89f94be13259 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.512375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 135/270] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:01.518258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23790-b556-4d9e-8b7f-374b4d04fdfd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.518539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23790-b556-4d9e-8b7f-374b4d04fdfd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.518816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23790-b556-4d9e-8b7f-374b4d04fdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.543821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-26b23790-b556-4d9e-8b7f-374b4d04fdfd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:01.545075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-26b23790-b556-4d9e-8b7f-374b4d04fdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:01.583515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:01.623502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 136/271] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:25:01.637031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721115-7700-43fd-a732-7cdcc38259b3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.637342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721115-7700-43fd-a732-7cdcc38259b3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.637613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721115-7700-43fd-a732-7cdcc38259b3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.639345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 136/272] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:01.647872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce467-e419-48d9-9eb1-ed187ca25010 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.648365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce467-e419-48d9-9eb1-ed187ca25010 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.648806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ce467-e419-48d9-9eb1-ed187ca25010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.678711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-114ce467-e419-48d9-9eb1-ed187ca25010 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:01.680251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-114ce467-e419-48d9-9eb1-ed187ca25010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:01.688637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 137/273] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:25:01.727499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39b3c-2e8f-44de-a3a9-abf423ea688a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.727782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39b3c-2e8f-44de-a3a9-abf423ea688a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.728062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39b3c-2e8f-44de-a3a9-abf423ea688a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.729797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 137/274] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:01.736584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:01.737049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:01.737327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:01.759982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:01.761649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:01.835781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 138/275] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:02.000377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39b3c-2e8f-44de-a3a9-abf423ea688a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.007629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:02.016772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39b3c-2e8f-44de-a3a9-abf423ea688a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.021783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.022949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.023233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.023507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.034477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:02.040621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:02.041477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:02.042271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:02.044058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 138/276] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:02.049779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.070583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eadbbe-128a-449f-9673-c31becbc88cc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.075186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.075801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.076080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.076349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.077015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:02.077318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.078940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.093073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 139/277] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:02.098676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.111096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb0242-0008-4045-82db-f44f8c7801de admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.118054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.118684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.119009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.119287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.122175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.124178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.126148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 139/278] 10.222.0.26 () {56 vars in 1201 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:02.131178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.136928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.147710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7793-b351-462c-bf31-468bbc15b05a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.148025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3a321-2f94-419d-a1d4-df0aefc3baf5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.153848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.154486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.154824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.155210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.157943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.158571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.158848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.159118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.166283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.168353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.169005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:02.170353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 140/279] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:02.175783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:02.176422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:02.177245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:02.178045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 140/280] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:02.183826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.189724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f1eb0-5ae8-47b4-b8f3-e254a90a428d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.199125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a690-f29b-483a-87f7-bc3643c4842e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.200903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.201574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.201863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.202138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee/groups/b84684ec4eb54149ab53992d417dcd28/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.204345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.205014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.205398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.205771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.206678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:02.206853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f42ad60455344fc9acf9d13733189ee, group_id=b84684ec4eb54149ab53992d417dcd28, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.207004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.208788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.209421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.220119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 141/281] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:02.220943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.337516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6912e-1f96-4e02-b967-2d20ba409693 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.359726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 141/282] 10.222.0.26 () {58 vars in 1463 bytes} [Wed Nov 2 07:25:02 2022] PUT /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee/groups/b84684ec4eb54149ab53992d417dcd28/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:25:02.360569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.385467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.386530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.387005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.387675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.401263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:02.407351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:02.408275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:25:02.409086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:02.411515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 142/283] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:02.417179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.468926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:02.502667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37175df3-7c12-48ac-b51f-fc1f7ecf4670 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.512252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.513305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.515160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.516585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.518328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.522297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.524579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 142/284] 10.222.0.26 () {56 vars in 1201 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:02.531084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.547991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cff1f6-5bfc-47db-902e-bd0220132565 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.559596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.560608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.561087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.561588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.565042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.567476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.570654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 143/285] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:02.577070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.592092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab232dc-f52c-4170-a7af-5d7b6c198eb5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.605357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583993e-f23a-4777-ad14-727a51e416b7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.608675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.608819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.609075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.609350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee/groups/b84684ec4eb54149ab53992d417dcd28/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.616642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f42ad60455344fc9acf9d13733189ee, group_id=b84684ec4eb54149ab53992d417dcd28, role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.619352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.651256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.651891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.652228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.652511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.653241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:02.653645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.655139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.665371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 143/286] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:02.670958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.707495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 144/287] 10.222.0.26 () {58 vars in 1463 bytes} [Wed Nov 2 07:25:02 2022] PUT /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee/groups/b84684ec4eb54149ab53992d417dcd28/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:25:02.789129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:02.807903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6dd99-8900-4117-8c11-339e8b80b99c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:02.848378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bc871-5195-4a03-9a03-75e68a600d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:02.848939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bc871-5195-4a03-9a03-75e68a600d54 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:02.849220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bc871-5195-4a03-9a03-75e68a600d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:02.849494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bc871-5195-4a03-9a03-75e68a600d54 None admin] PATH_INFO: `/v3/users/f670155de2e44cfc9775b17462ae1004` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:02.851435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bc871-5195-4a03-9a03-75e68a600d54 None admin] RBAC: Authorizing `identity:get_user(user_id=f670155de2e44cfc9775b17462ae1004)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:02.852956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bc871-5195-4a03-9a03-75e68a600d54 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:02.855025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 144/288] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/users/f670155de2e44cfc9775b17462ae1004 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:02.860574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:02.863826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:02.996680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55000fcd-3c74-42cd-b93d-88aa19c609cf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:03.035151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:03.035784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.036061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.036332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.037078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] RBAC: Adding query filter params (role.id=61efc5b63c524de98263a5662cf6ddb1, user.id=f670155de2e44cfc9775b17462ae1004, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:03.037386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:03.039541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073667c-5a10-4e29-ba92-f51432e51a07 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:03.056553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 145/289] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Nov 2 07:25:02 2022] GET /identity/v3/role_assignments?user.id=f670155de2e44cfc9775b17462ae1004&scope.system=all&role.id=61efc5b63c524de98263a5662cf6ddb1 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:03.454904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6de9b-e744-4e97-bfde-23e6ed20ca89 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.455401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6de9b-e744-4e97-bfde-23e6ed20ca89 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.455474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6de9b-e744-4e97-bfde-23e6ed20ca89 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.456805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 145/290] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:03.463450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.463735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.464015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.487283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:03.488474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:03.554407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:25:03.921998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6de9b-e744-4e97-bfde-23e6ed20ca89 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:03.939421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6de9b-e744-4e97-bfde-23e6ed20ca89 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:03.946134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:03.946766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.947049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.947323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.962435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:03.967824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:03.969898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:03.971885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 146/292] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:03.975105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:03.984472 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a1907-814a-428a-ab13-d5c8af208a98 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:03.994197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:03.994819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.995099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.995376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.996050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:03.996357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:03.997993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:03.999572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:04.012733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 147/293] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:04.018703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:04.034816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059fd50-7a98-4454-9f74-61b7a750d9b5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:04.040911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:04.041600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.041893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.042174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] PATH_INFO: `/v3/groups/65aafd8e61c5455eae37b349f9737e10` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.047773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] RBAC: Authorizing `identity:get_group(group_id=65aafd8e61c5455eae37b349f9737e10)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:04.049790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:04.051714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 147/294] 10.222.0.26 () {56 vars in 1201 bytes} [Wed Nov 2 07:25:04 2022] GET /identity/v3/groups/65aafd8e61c5455eae37b349f9737e10 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:04.057684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:04.067843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa90668-b4ee-4f70-bb87-093d48a31fa8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:04.077225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4a27-6c28-41d9-a12e-4d4251121211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:04.077894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4a27-6c28-41d9-a12e-4d4251121211 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.078178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4a27-6c28-41d9-a12e-4d4251121211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.078452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4a27-6c28-41d9-a12e-4d4251121211 admin admin] PATH_INFO: `/v3/projects/a48f833e014547bea9a266aeb3854e0b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.079588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4a27-6c28-41d9-a12e-4d4251121211 admin admin] RBAC: Authorizing `identity:get_project(project_id=a48f833e014547bea9a266aeb3854e0b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:04.081405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4a27-6c28-41d9-a12e-4d4251121211 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:04.083064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 148/295] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Nov 2 07:25:04 2022] GET /identity/v3/projects/a48f833e014547bea9a266aeb3854e0b => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:04.089148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:04.100871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a8f9-ab69-4a7d-9997-3187bd52ea20 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:04.108650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe80b3d-ef34-4c65-aac8-1535112f6dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:04.109371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe80b3d-ef34-4c65-aac8-1535112f6dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.109722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe80b3d-ef34-4c65-aac8-1535112f6dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.110054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe80b3d-ef34-4c65-aac8-1535112f6dfe admin admin] PATH_INFO: `/v3/projects/a48f833e014547bea9a266aeb3854e0b/groups/65aafd8e61c5455eae37b349f9737e10/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.112111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe80b3d-ef34-4c65-aac8-1535112f6dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48f833e014547bea9a266aeb3854e0b, group_id=65aafd8e61c5455eae37b349f9737e10, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:04.115099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe80b3d-ef34-4c65-aac8-1535112f6dfe admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:04.182369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 148/296] 10.222.0.26 () {58 vars in 1463 bytes} [Wed Nov 2 07:25:04 2022] PUT /identity/v3/projects/a48f833e014547bea9a266aeb3854e0b/groups/65aafd8e61c5455eae37b349f9737e10/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:04.785590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0872e2-8adc-4f41-8b36-026fcaed310f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.785888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0872e2-8adc-4f41-8b36-026fcaed310f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.786163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0872e2-8adc-4f41-8b36-026fcaed310f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.788212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 149/297] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:04.794277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8abb8-98e9-48f9-aab3-cc60d5b1be04 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.794751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8abb8-98e9-48f9-aab3-cc60d5b1be04 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.794821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8abb8-98e9-48f9-aab3-cc60d5b1be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.815900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d9c8abb8-98e9-48f9-aab3-cc60d5b1be04 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:04.817086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d9c8abb8-98e9-48f9-aab3-cc60d5b1be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:04.929572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 149/298] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:04.963905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862b97-8277-4a80-8931-4a27cb8781c6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.963905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862b97-8277-4a80-8931-4a27cb8781c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.963905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862b97-8277-4a80-8931-4a27cb8781c6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.964584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 150/299] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:04.969504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a32b6-3abf-41a0-81dd-429fe028c5a9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.969936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a32b6-3abf-41a0-81dd-429fe028c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.970099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a32b6-3abf-41a0-81dd-429fe028c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.996852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-244a32b6-3abf-41a0-81dd-429fe028c5a9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:04.998108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-244a32b6-3abf-41a0-81dd-429fe028c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:05.058454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:05.088191 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 150/300] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:05.291878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c600b-1fbc-437c-aece-b026835a52ca None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:05.292863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c600b-1fbc-437c-aece-b026835a52ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:05.293364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c600b-1fbc-437c-aece-b026835a52ca None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:05.294939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 151/301] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:05.300303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:05.300812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:05.301292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:05.326323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:05.327809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:05.352960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c600b-1fbc-437c-aece-b026835a52ca None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:05.429567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 151/302] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:05.507950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c600b-1fbc-437c-aece-b026835a52ca None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:05.531178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:05.555263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:05.556237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:05.557567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:05.558068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:05.578909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:05.585700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:05.586540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:05.587355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 152/303] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:05.592605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:05.685949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:05.747212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0db60-148d-463e-9421-9e94d4cc1062 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:05.774278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:05.778845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f638-f05b-497f-94ad-c61dad25dd12 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:05.810224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:05.810870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:05.811152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:05.811595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:05.829913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:05.835413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:05.836284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:05.837064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:05.837690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:05.837690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:05.837690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:05.837690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:05.838146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:05.838364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:05.839774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:05.840196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 152/304] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:05.841247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:05.855355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 153/305] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:05.856191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:05.978003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474bcd9-4764-45be-9485-c5e12945b049 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:05.993710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13658f68-29a6-4cb7-9b94-de7b52176da3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.008775 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.020795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.025222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.025222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.025222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.034875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:06.036568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.037278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.038204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.038590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.039358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:06.039758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.041230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1f7ed-7a5a-4eb1-a40d-5781fc908acd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:06.043375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:06.044231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:25:06.044991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:06.047002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 153/306] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:06.047729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.051900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 154/307] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:06.054924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14456-2945-471b-8329-1aa66134fe70 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.055237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14456-2945-471b-8329-1aa66134fe70 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.055518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14456-2945-471b-8329-1aa66134fe70 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.056954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 155/308] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:06.058026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14456-2945-471b-8329-1aa66134fe70 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.095842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.192528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda055-858d-4c80-b589-3d37506fa266 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.194697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14456-2945-471b-8329-1aa66134fe70 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.247148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.247495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.247698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.247976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.248632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:06.248934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.250323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.252533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be23b-71b7-48e5-9c45-1f7c18d07d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.253361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be23b-71b7-48e5-9c45-1f7c18d07d97 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.253919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be23b-71b7-48e5-9c45-1f7c18d07d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.254406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be23b-71b7-48e5-9c45-1f7c18d07d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.261115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 156/309] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:06.262988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.316846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.340360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be23b-71b7-48e5-9c45-1f7c18d07d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.341882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be23b-71b7-48e5-9c45-1f7c18d07d97 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.378214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.398689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e8f1-f739-4102-96b4-242851102724 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.443397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.444570 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.444851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.445122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.477247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 154/310] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:06.478660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.478943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.479212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.503744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:06.506886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:06.531751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.533203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.575331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.586696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 155/311] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:06.587587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.651750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 157/312] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:06.652600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.674651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.724584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be4cd-4345-4fe8-95a5-c5804ff3bf4a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.768767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.769804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.770285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.770767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.770867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb35ea-b821-48e3-a7c4-9b986b4909f2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.815532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.816175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.816458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.816734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.817893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.820399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.822086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 158/313] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:06.824847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.835265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.860798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.862897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.940562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:06.953508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec452d6-314d-482f-b4d5-6b2cebcc3516 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:06.981698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 156/314] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:06.982567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:06.988656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:06.989292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:06.989605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:06.989885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] PATH_INFO: `/v3/projects/5152f238881e4a83b5506e208ad7f86f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:06.991557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] RBAC: Authorizing `identity:get_project(project_id=5152f238881e4a83b5506e208ad7f86f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:06.993005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:06.994834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 159/315] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/projects/5152f238881e4a83b5506e208ad7f86f => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:06.995455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.101129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.118499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01b7a5-9c55-45cc-bf6d-2536e08a8f8c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.141616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfaccf-b937-4542-8973-d5f1d584054e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.161724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.162388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.162678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.162956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.164069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.165514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.167117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 157/316] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.167874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.184443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.185076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.185362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.185661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.204081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.204236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:07.209886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:07.216912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 160/317] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:07.217717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.291933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5307-e5e6-4abc-bc9e-aefb7e1b77a8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.322662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fd2a7-a911-4a95-bc1f-482aaf8c7612 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.326548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923ec5e-405d-4d4a-a972-82303e060d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.327171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923ec5e-405d-4d4a-a972-82303e060d48 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.327450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923ec5e-405d-4d4a-a972-82303e060d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.327720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923ec5e-405d-4d4a-a972-82303e060d48 None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.328823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923ec5e-405d-4d4a-a972-82303e060d48 None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.330279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923ec5e-405d-4d4a-a972-82303e060d48 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.331899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 158/318] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.332988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426291e-00c7-4b80-b1f0-3fb366b5cb93 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.333269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426291e-00c7-4b80-b1f0-3fb366b5cb93 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.333574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426291e-00c7-4b80-b1f0-3fb366b5cb93 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.334770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 159/319] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:07.335455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426291e-00c7-4b80-b1f0-3fb366b5cb93 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.356769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.357391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.357760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.358034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.359124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.360542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.362126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 161/320] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.362875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.366304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.432987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.437145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426291e-00c7-4b80-b1f0-3fb366b5cb93 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.458922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27365a9-0e3b-42a6-970d-e08cab218dfe None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.470922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.471529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.471811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.472091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.472821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] RBAC: Adding query filter params (group.id=b84684ec4eb54149ab53992d417dcd28, role.id=e275c993797f4c7eb8ee1081d5088b3a, scope.project.id=5152f238881e4a83b5506e208ad7f86f) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:07.473132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.474588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.481092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 160/321] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/role_assignments?group.id=b84684ec4eb54149ab53992d417dcd28&scope.project.id=5152f238881e4a83b5506e208ad7f86f&role.id=e275c993797f4c7eb8ee1081d5088b3a => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.481976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.503450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.504223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.504568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.504908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.505694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:07.506100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.507519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135211-8317-4f10-836d-a5deb3309525 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.518249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 162/322] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.523095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.523403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.523651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.544790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:07.546192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:07.604123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8d36-893e-494b-b683-b2c7137d0c02 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.614779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.627895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 163/323] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:07.628901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.660070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.660708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.660988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.661259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.664638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.665743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.667463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 161/324] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.672265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.705681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.757361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de1cbb-91ce-4610-9f2c-db3a21d3c97d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.793411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.794040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.794320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.794594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.795318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] RBAC: Adding query filter params (group.id=b84684ec4eb54149ab53992d417dcd28, role.id=87acec30d5ae421e8ff804046c98950a, scope.project.id=5152f238881e4a83b5506e208ad7f86f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:07.795623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.797037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.797668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad5193-4af5-4606-a4a5-8524d9c7e560 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.810355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 164/325] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/role_assignments?group.id=b84684ec4eb54149ab53992d417dcd28&scope.project.id=5152f238881e4a83b5506e208ad7f86f&role.id=87acec30d5ae421e8ff804046c98950a => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.810355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:07.867699 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.868966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.870149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.870585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.878215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:07.924773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedeed9-fdc7-4fb5-987f-0958d3187ff5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:07.958026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.960096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.964805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:07.965720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:07.966172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:07.966642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:07.967543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] RBAC: Adding query filter params (group.id=b84684ec4eb54149ab53992d417dcd28, role.id=87acec30d5ae421e8ff804046c98950a, scope.project.id=3f42ad60455344fc9acf9d13733189ee) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:07.968025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:07.969675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:07.977562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 165/326] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/role_assignments?group.id=b84684ec4eb54149ab53992d417dcd28&scope.project.id=3f42ad60455344fc9acf9d13733189ee&role.id=87acec30d5ae421e8ff804046c98950a => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:07.978651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.007782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.109566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 162/327] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:08.110459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9b155-400c-44f3-89bd-04480b96e72e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.116869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.137315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.150717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.151369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.151647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.151922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.165518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:08.170710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:08.171758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:08.172680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 166/328] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:08.178264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.251580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0f807-4d02-4fce-a073-3938f8cf9a1b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.287520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.294481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.295115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.295397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.295670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] PATH_INFO: `/v3/projects/3f42ad60455344fc9acf9d13733189ee` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.296787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] RBAC: Authorizing `identity:get_project(project_id=3f42ad60455344fc9acf9d13733189ee)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:08.298259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:08.299899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 163/329] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/projects/3f42ad60455344fc9acf9d13733189ee => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:08.303080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d0c67-6f04-437a-a3a5-3a49c5ba2d0d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.305739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.345882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.346553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.346761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.347557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.348123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:08.348435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:08.350397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:08.359033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 167/330] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:08.364483 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.415760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.423894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b560-248c-41dd-996b-9bea6144817e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.462152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.462849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.463067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.463728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] PATH_INFO: `/v3/groups/b84684ec4eb54149ab53992d417dcd28` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.464445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] RBAC: Authorizing `identity:get_group(group_id=b84684ec4eb54149ab53992d417dcd28)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:08.466222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:08.467481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 164/331] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/groups/b84684ec4eb54149ab53992d417dcd28 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:08.473715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.486959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fed44e-3488-4e06-86e5-28bfea8402aa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.531831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.532762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.532762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.533072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.549658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.590892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9c5b7-fc11-434c-9f20-6ef4a47a40fd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.611826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:08.613284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:08.628899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.629504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.629817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.630090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.630810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] RBAC: Adding query filter params (group.id=b84684ec4eb54149ab53992d417dcd28, role.id=e275c993797f4c7eb8ee1081d5088b3a, scope.project.id=3f42ad60455344fc9acf9d13733189ee) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:08.631728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:08.633148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:08.638823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 165/332] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/role_assignments?group.id=b84684ec4eb54149ab53992d417dcd28&scope.project.id=3f42ad60455344fc9acf9d13733189ee&role.id=e275c993797f4c7eb8ee1081d5088b3a => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:08.664748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.723892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 168/333] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:25:08.729773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.834855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952dce-fafe-4c18-ab70-b0b52a02c3c2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:08.863022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:08.869343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:08.870005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.870313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.870555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] PATH_INFO: `/v3/projects/a48f833e014547bea9a266aeb3854e0b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.871660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=a48f833e014547bea9a266aeb3854e0b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:08.873082 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:08.874732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 166/334] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/projects/a48f833e014547bea9a266aeb3854e0b => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:08.880300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:08.979328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61ffa-2350-4e75-81fc-57c6e1850e4f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:09.013434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb25d-99a8-40e8-a491-254a3c2fd8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:09.014085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb25d-99a8-40e8-a491-254a3c2fd8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:09.014364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb25d-99a8-40e8-a491-254a3c2fd8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:09.014632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb25d-99a8-40e8-a491-254a3c2fd8a9 None admin] PATH_INFO: `/v3/groups/65aafd8e61c5455eae37b349f9737e10` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:09.015710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceb25d-99a8-40e8-a491-254a3c2fd8a9 None admin] RBAC: Authorizing `identity:get_group(group_id=65aafd8e61c5455eae37b349f9737e10)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:09.017138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceb25d-99a8-40e8-a491-254a3c2fd8a9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:09.018976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 169/335] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Nov 2 07:25:08 2022] GET /identity/v3/groups/65aafd8e61c5455eae37b349f9737e10 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:09.024871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:09.121345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e168-8fe3-4534-af0a-fa0929865fd5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:09.153301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:09.153913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:09.154194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:09.154464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:09.155174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] RBAC: Adding query filter params (group.id=65aafd8e61c5455eae37b349f9737e10, role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=a48f833e014547bea9a266aeb3854e0b) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:09.155480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:09.156890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc395ef-a4a2-4ca4-b466-b7874d6ae1cf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:09.162960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 167/336] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Nov 2 07:25:09 2022] GET /identity/v3/role_assignments?group.id=65aafd8e61c5455eae37b349f9737e10&scope.project.id=a48f833e014547bea9a266aeb3854e0b&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:11.772141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e18431-16a3-4ae5-ad9e-bbb473ee5b5c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:11.773185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e18431-16a3-4ae5-ad9e-bbb473ee5b5c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:11.773707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e18431-16a3-4ae5-ad9e-bbb473ee5b5c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:11.775523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 170/337] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:11.780616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97214b6-8971-4f24-8891-2509436a9ca5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:11.781449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97214b6-8971-4f24-8891-2509436a9ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:11.781976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97214b6-8971-4f24-8891-2509436a9ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:11.805666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b97214b6-8971-4f24-8891-2509436a9ca5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:11.816933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b97214b6-8971-4f24-8891-2509436a9ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:11.887359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:11.901186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 168/338] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:11.991989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96628d07-4de6-42ee-9bc6-2e2d210c62ee None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:11.992630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96628d07-4de6-42ee-9bc6-2e2d210c62ee None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:11.993110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96628d07-4de6-42ee-9bc6-2e2d210c62ee None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:11.994936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 171/339] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:11.999998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77402-49fb-410a-b7b1-e08e17058283 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.000290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77402-49fb-410a-b7b1-e08e17058283 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.000568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77402-49fb-410a-b7b1-e08e17058283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.026725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6dc77402-49fb-410a-b7b1-e08e17058283 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:12.027848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6dc77402-49fb-410a-b7b1-e08e17058283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:12.111248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 169/340] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:12.330122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5084-7902-4035-886f-b90480c19fdf None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.330301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5084-7902-4035-886f-b90480c19fdf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.330579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5084-7902-4035-886f-b90480c19fdf None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.332193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 172/341] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:12.337383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.337702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.337980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.360321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:12.361610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:12.400573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5084-7902-4035-886f-b90480c19fdf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:12.424103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:12.479860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 170/342] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:12.496835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:12.549008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5084-7902-4035-886f-b90480c19fdf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:12.585306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:12.586118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.586314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.586548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.598489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:12.598763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:12.601832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bd30a01d-821c-4820-b7e3-284d11160ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:12.621906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:12.622909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:12.623764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:12.623764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:12.623764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:12.623764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 173/343] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:12.629139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1863-50b9-4799-8c3c-c7ee6292e0d2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.629139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1863-50b9-4799-8c3c-c7ee6292e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.629139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1863-50b9-4799-8c3c-c7ee6292e0d2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.629139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 174/344] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:12.630152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1863-50b9-4799-8c3c-c7ee6292e0d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:12.660891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da2c1-4d52-4a70-86f4-7f78bc9c750f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:12.701013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:12.702048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.702629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.703110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.714476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:12.716233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:12.717440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d90cf323-945b-4452-8ebc-278773a646fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:12.735098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:12.736018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:12.736854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:12.736854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:12.736854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:12.738939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 171/345] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:12.740979 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.741477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.741970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.761092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:12.761424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1863-50b9-4799-8c3c-c7ee6292e0d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:12.763375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:12.804660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:12.805329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.805532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.805839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.806473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:12.806771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:12.808123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:12.825101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 175/346] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:12.825101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:12.839591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 172/347] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:12.840467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:12.875308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:12.942769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbb248-bf77-4480-a4ef-e5e043b215b4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:12.968986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe223-85f5-4fe4-83d8-8545ff9010a2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:12.980638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:12.981477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:12.981930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:12.982347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:12.992961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:12.994647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.000938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:13.009918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:13.025325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:13.026204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:13.026204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:13.026204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:13.026204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 173/348] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:13.026424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.026424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.026424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.026424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.026677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:13.026677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.026799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.026862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.032023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 176/349] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:13.032955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.122072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:13.139083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4982-287a-45d3-a040-f54faae67b47 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.156633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386b35-5be2-49be-b28a-67a424a716de None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.179139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.179862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.180167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.180544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.181192 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.182637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.190897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.191497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.191771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.192040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.192671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:13.192968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.194401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.206820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 177/350] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:13.208374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.256397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:13.260692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 174/351] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:13 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:13.261581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.327303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2f8c9-d34d-4698-90d4-44195a028276 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.368928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa34646-3749-49cc-89a8-d69c8a78d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.369991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34646-3749-49cc-89a8-d69c8a78d550 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.370467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34646-3749-49cc-89a8-d69c8a78d550 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.370939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa34646-3749-49cc-89a8-d69c8a78d550 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.371271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422a3b0-9c5d-411e-a4c4-6b8b2f0c4add None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.371995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa34646-3749-49cc-89a8-d69c8a78d550 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.373727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa34646-3749-49cc-89a8-d69c8a78d550 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.408526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.409166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.409442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.409755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.421102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.422586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.424790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:13.437901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:13.438911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:13.439774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:13.439774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:13.439774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:13.439774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 175/352] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:13.439988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.450897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 178/353] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:13 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:13.452138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183088c5-f163-4a11-a0c6-563fb8769d5a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.453366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183088c5-f163-4a11-a0c6-563fb8769d5a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.453366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183088c5-f163-4a11-a0c6-563fb8769d5a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.461803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 179/354] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:13.461803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183088c5-f163-4a11-a0c6-563fb8769d5a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.572109 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9c1c-1716-4cb4-a2cc-7420942835f3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.608607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:13.611131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.611951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.612399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.612833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.613529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183088c5-f163-4a11-a0c6-563fb8769d5a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.613863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.615760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.655724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.656252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.656526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.656794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.657435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:13.657754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.659115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c824868-48cb-4766-b9b3-2fd0bd4abd49 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:13.671807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:13.673087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.673371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.673673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.692429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:13.694279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:13.718004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 176/356] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:13 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:13.719377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:13.774101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 181/357] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:13.826949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:13.908438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406384ce-47ce-4dd9-b02f-6d4497892700 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:13.953988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:13.954970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:13.955506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:13.955977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:13.956815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:13.958471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:14.039618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 177/358] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:13 2022] POST /identity/v3/users => generated 249 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:14.040886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:14.159672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:14.169805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea719-b99a-4bdf-a793-7313f1c8823e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:14.206365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:14.206990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:14.207267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:14.207537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:14.208329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:14.209887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:14.249719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:25:14.249719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:25:14.249719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [parameters: {'id': 'da7999067ba548c79c0169f476ccb325', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:25:14.249719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:25:14.257114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:25:14.258051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:25:14.258936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:25:14.259747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:25:14.260564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:25:14.261310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'id': 'da7999067ba548c79c0169f476ccb325', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:14.263832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:25:14.265876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:14.268138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 182/359] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Nov 2 07:25:14 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:14.268277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:14.403416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f9ab9-e8f4-469a-b50f-c31cacbd1a0f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:14.410608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:14.440033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7810160-785f-4be5-9d57-a9be44446de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:14.440695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7810160-785f-4be5-9d57-a9be44446de6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:14.440970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7810160-785f-4be5-9d57-a9be44446de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:14.441235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7810160-785f-4be5-9d57-a9be44446de6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:14.453772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7810160-785f-4be5-9d57-a9be44446de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d7810160-785f-4be5-9d57-a9be44446de6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:14.458680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:14.461707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:14.462470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 178/360] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:14.466406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:14.574206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194e65-79d1-4b8c-9aa3-6c92fb5fbb8b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:14.619303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:14.620216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:14.620660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:14.621111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:14.622018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:14.622546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:14.624077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ecec-8918-430e-aef1-c731a46168b6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:14.635945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 183/361] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:16.011594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88764ebf-47bd-4b8f-8a6d-4a6d6ec543c4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.012598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88764ebf-47bd-4b8f-8a6d-4a6d6ec543c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.013092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88764ebf-47bd-4b8f-8a6d-4a6d6ec543c4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.014667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 179/362] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:16.024624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dabbf-f596-4dfb-a5ac-bc8466563ec9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.025434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dabbf-f596-4dfb-a5ac-bc8466563ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.025935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dabbf-f596-4dfb-a5ac-bc8466563ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.040921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79194dc6-268b-422c-9e13-230cafd92df7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.041202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79194dc6-268b-422c-9e13-230cafd92df7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.041475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79194dc6-268b-422c-9e13-230cafd92df7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.043087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 180/363] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:16.049422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-872dabbf-f596-4dfb-a5ac-bc8466563ec9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:16.049837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e430-e3b6-46f8-afae-84a772d928cf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.050123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e430-e3b6-46f8-afae-84a772d928cf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.050399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e430-e3b6-46f8-afae-84a772d928cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.050642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-872dabbf-f596-4dfb-a5ac-bc8466563ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:16.062309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:16.082504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b591e430-e3b6-46f8-afae-84a772d928cf None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:16.083715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b591e430-e3b6-46f8-afae-84a772d928cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:16.142156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 184/364] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:16.187387 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 181/365] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:16.342173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614e44a-632b-4588-af17-a6b8438e28b5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.342490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614e44a-632b-4588-af17-a6b8438e28b5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.342720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614e44a-632b-4588-af17-a6b8438e28b5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.344057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 185/366] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:16.358738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.359030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.359311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.386484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:16.387672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:16.474937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 182/367] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:16.500236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614e44a-632b-4588-af17-a6b8438e28b5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.512414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.552776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:16.625593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614e44a-632b-4588-af17-a6b8438e28b5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:16.630106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fde6e-5695-4462-92c5-1de188e36671 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:16.664985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:16.665879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.666677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.667147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.679436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:16.684768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:16.685634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:16.686415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:16.694184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 186/368] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:16.695931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.705690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:16.730840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:16.731574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.731914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.732251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.762400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:16.767720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:16.768759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:16.769660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:16.778665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 183/369] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:16.781024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.807282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0590f-e989-4cbe-a784-81e37958e0dc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:16.844313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:16.849417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.849417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.849417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.849417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:16.849417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:16.849417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:16.862846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 187/370] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:16.864667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.881816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:16.899446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49109649-4d29-4d86-942e-4ee469b85e51 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:16.936078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:16.936902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.937344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.937765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.944041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:16.951079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:16.956331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:16.966237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 184/371] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:16.967003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.984124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cbf76-0c26-4654-a161-8f233017049a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.026458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.027080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.027360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.027642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.028300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:17.028598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.030466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.044507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 188/372] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:17.044507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.089902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8944-956e-4bf1-bc6e-cb2335d73e2c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.124153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.125019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.125474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.125770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.136986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.138407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.145218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.151225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f59cd-ecc2-4618-bdd6-ac3384a7711a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:17.156634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:17.157462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:17.158541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:17.158541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:17.158541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:17.158541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 185/373] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:17.160614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.181580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.187728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.188479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.188755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.189124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.189757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:17.190343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.191547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ec11-09b0-4005-af6e-2d9b699d55d7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.201053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 189/374] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:17.203441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff6bc-0625-4ca1-9450-7e249c36192b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.204055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff6bc-0625-4ca1-9450-7e249c36192b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.204530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff6bc-0625-4ca1-9450-7e249c36192b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.206479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 190/375] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:17.208015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff6bc-0625-4ca1-9450-7e249c36192b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.267919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0d1e-f593-4546-9ca1-e2665164fe1f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.302612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.303289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.303572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.303855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.314822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.316386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.321513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff6bc-0625-4ca1-9450-7e249c36192b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:17.332724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:17.333675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:17.335140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:17.335140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:17.335140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:17.335140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 186/376] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:17.335352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.367447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.368577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.369027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.369464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.370580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:17.371770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.373300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e192e59-f7e8-4c3f-ad6b-c0992832f4b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.392651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 191/377] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:17.392651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.392651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.392651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.394543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.411415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:17.412675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:17.449575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f83d-afb8-45b9-85f5-b837f30e1e22 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.464601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.486469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 192/378] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:17.486711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.487534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.487817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.488121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.488301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.510769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.512788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:17.529528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:17.530490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:17.531322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:17.531322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:17.531322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:17.531322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 187/379] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:17.532000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.597388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2396d8-753e-46ab-96f3-c5688ca511cd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.636569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.637171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.637447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.637740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.638370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:17.638671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.639229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72013a5-6b8e-48b6-8815-4de175fec6f1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.640022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6cd83-212e-4832-a928-a84907072ee8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.640890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.656369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 193/380] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:17.656369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd028-eba2-4643-8f60-136c5d6033d5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.656369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd028-eba2-4643-8f60-136c5d6033d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.656369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cd028-eba2-4643-8f60-136c5d6033d5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.656369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 194/381] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:17.656369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cd028-eba2-4643-8f60-136c5d6033d5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.678640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.679260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.679539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.679809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.687086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.688751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ebf16511-58a5-43fe-92d5-669d97e5d04d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:17.701461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:17.702474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:17.703409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 188/382] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:17.704058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.704058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.704183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.711671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.722126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:17.728920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:17.773617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cd028-eba2-4643-8f60-136c5d6033d5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.792777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 189/383] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:17.793636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.808496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.809512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.809972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.810242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.810889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:17.811371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.813030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.826233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 195/384] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:17.827602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.885089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.894428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1a23-58aa-4bf5-949c-0fc0cb10cf5a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.930497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.931065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.931330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.931601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.932831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758a1d-f36a-45d5-bf5c-faaf2150c7e5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:17.935125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:17.939377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.943566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:17.952391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:17.953237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:17.954113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 190/385] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:17.954661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:17.972966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:17.973603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:17.973883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:17.974154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:17.975401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:17.975699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:17.977104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.013667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 196/386] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:18.014306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.065874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57ebc5-d2c8-4f4f-a0fa-a74b49faac68 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.098279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.099005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.099793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.100065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.109981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:18.115845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.116854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:18.117670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:18.118291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58f4be-1b02-441e-aa41-302cca5a55b3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.118669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 191/387] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.118912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.132705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.151578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454aee0-0112-478b-beea-179c86921730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.152284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454aee0-0112-478b-beea-179c86921730 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.152441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454aee0-0112-478b-beea-179c86921730 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.152711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454aee0-0112-478b-beea-179c86921730 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.159761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454aee0-0112-478b-beea-179c86921730 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.161184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454aee0-0112-478b-beea-179c86921730 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a454aee0-0112-478b-beea-179c86921730 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:18.174153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.175006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:18.175874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 197/388] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.176414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454aee0-0112-478b-beea-179c86921730 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.197045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.220322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9ee1-557b-4cc4-ae41-2236cb279577 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.253386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.254033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.254313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.254585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.255298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:18.255628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.257045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.275654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454aee0-0112-478b-beea-179c86921730 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.293274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 192/389] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:18.294129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.310353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.311001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.311276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.311545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.321439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.322911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:18.337691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.338608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:18.339441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:18.339441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.339441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:18.339441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 198/390] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.339665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.363287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.393040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0e91-6a01-4b00-b146-415439d83f1a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.407535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.427290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.429782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.429782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.429782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.435662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2430e84-e8a7-4deb-9634-a9ee0a9bc7c2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.438299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.439730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:18.454468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.455521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:18.456331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:18.456331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.456331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:18.456331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 193/391] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.456331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.473113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.473751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.474033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.474842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.475513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:18.475814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.477183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.485321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 199/392] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:18.486141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.561512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eba48-dc2e-450c-a02d-78efc671a5da None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.583335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.584385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b299758-432d-4add-a29e-6921db550cf2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.594821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.595413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.595826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.596097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.596813 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:18.597112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.598564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.615370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 194/393] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:18.616204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.619277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355e36b-8794-456c-a101-522ace69252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.620679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355e36b-8794-456c-a101-522ace69252a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.620963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355e36b-8794-456c-a101-522ace69252a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.621242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355e36b-8794-456c-a101-522ace69252a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.623249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.633291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355e36b-8794-456c-a101-522ace69252a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.635786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355e36b-8794-456c-a101-522ace69252a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c355e36b-8794-456c-a101-522ace69252a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:18.649574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.650462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:18.651293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:18.651293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.651293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:18.651293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 200/394] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.651499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355e36b-8794-456c-a101-522ace69252a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.718770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1fa04-bdef-4468-a12e-54c74c6e617f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.747442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355e36b-8794-456c-a101-522ace69252a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.751273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.751866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.752139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.752404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.753026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:18.753323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.754704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.766189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 195/395] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:18.767707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.781093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.781800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.782078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.782349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.783010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:18.783310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.784654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.796111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 201/396] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:18.796891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.811462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.841690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:18.868231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f3458-467b-4f81-bd21-8e16bd29ba0c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.892689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2180f-4067-4d6b-8bfc-12f80cece7f5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.902403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.903027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.903318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.903588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.913929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.915361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.927034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.928164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.928438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.928707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:18.929518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.930380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:18.931346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:18.931346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.931346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:18.931346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 196/397] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.931346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.940400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.941872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:18.956780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:18.957826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:18.958760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:18.958760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:18.958760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:18.958760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 202/398] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:18.958760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.028084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.036347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712dbfd-918d-46f0-931a-6900ab18383a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.050545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.054986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26799264-0f3b-4808-ad62-902768d580c9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.070550 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.071143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.071417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.071692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.072319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:19.072615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.074003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.085432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 197/399] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:19.086108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.091339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.091960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.092235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.092503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.099219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.100646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:19.111717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:19.112605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:19.113420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:19.117679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 203/400] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:19.118665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.182613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850bd8-9fd0-485d-909d-824d3fc0958b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.216051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.216232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920145-9ead-403e-8e92-1f2a81bf1c5a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.216643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.216944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.217216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.217879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.219308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.249406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.250032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.250310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.250582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.251211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:19.251511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.252868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.264486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 204/401] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:19.265296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.281678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 198/402] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:19 2022] POST /identity/v3/users => generated 247 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:19.281678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.295488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.312495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.415954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1930ba-ede6-4dfd-975b-e816415e58f4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.452777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbbbec-83a4-433e-a1f2-2fa56bea4f75 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.463205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.463892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.464232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.464557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.465198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:19.465497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.468900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.484870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 205/403] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:19.485830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.496977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.497660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.497939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.498213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.505813 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.507252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:19.519937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:19.520790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:19.521714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 199/404] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:19.522164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.583041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.611361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daf13d-2910-4086-8808-8629de5346ae None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.612487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.653679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646575c6-d3e1-426e-9782-8d75656b6449 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.664468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.665076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.665354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.665670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.666355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:19.666657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.668068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.686131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 206/405] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:19.687133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.695495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.696132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.696411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.696683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.704742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.706211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:19.717714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:19.718627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:19.719476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 200/406] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:19.720019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.801206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca392-0211-4367-a1b7-e0b6d6a6a435 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.827528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f581e-89a5-4356-8a9e-c94d612e1594 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:19.836279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.836830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.837112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.837378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.844025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.845462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.847326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.855605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:19.857810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:19.859028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:19.859858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 207/407] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:19.860307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.868890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:19.869495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:19.869942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:19.870447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:19.870897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:19.871201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:19.872631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:19.895428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 201/408] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:19.895428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:19.969861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a101f71-1fcf-4c85-8d33-d3907bc27b61 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.002815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8562-f424-4656-a15d-f1a93eeee0fa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.005015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.005810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.006092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.006365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0297ece9087142c1987312d97a6a3867/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.022532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=0297ece9087142c1987312d97a6a3867, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.023979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.039821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.040428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.040709 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.040984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.041737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:20.042044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.043484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.060468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 202/409] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Nov 2 07:25:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:20.064438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:20.091013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 208/410] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:19 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0297ece9087142c1987312d97a6a3867/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:20.091849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:20.121446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:20.160244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:20.200273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf4e0-66ca-4d40-be56-a690132b3ee6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.227079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9e33c-847b-45ae-9ebe-f07aa63247f1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.263681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.264730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.265171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.265698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.267019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:20.267553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.268061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.268821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.269251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.269688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.270351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0d3201a663964573be66ab4ad0d13b8b/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.285635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 203/411] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:20.285635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:20.294165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=0d3201a663964573be66ab4ad0d13b8b, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.295624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.368417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 209/412] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:20 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0d3201a663964573be66ab4ad0d13b8b/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:20.369332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:20.398190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4da4-306f-4bfa-876b-7813be6d00aa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.408594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:20.445085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.446324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.446798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.447257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.460801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.462738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:20.480822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:20.481822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:20.482656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:20.482656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:20.482656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:20.490508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 204/413] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:20.492604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:20.595460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:20.606641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58c861-19b7-4d48-99e9-cbcdbf8b0f61 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.646643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae64e9-c820-429f-b128-c0f97d190611 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.679809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.681035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.681524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.682018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/4f95b0b156df4f26a498c8d332cc100a/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.684746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.685472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.686641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.686641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.686882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:20.687278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.688719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.701390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=4f95b0b156df4f26a498c8d332cc100a, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.704452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.704645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 205/414] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:20.710265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:20.737942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:20.799499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 210/415] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:20 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/4f95b0b156df4f26a498c8d332cc100a/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:20.822064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0f85d-983b-4037-8d3b-9276873e52be None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:20.861839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:20.864490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:20.865644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:20.866111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:20.874459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:20.876231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:20.889236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:20.890146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:20.890983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:20.893329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 206/416] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:20.899411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:21.009431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e57c1-1bef-4c6e-bb0e-012128b48fc5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:21.047011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:21.048188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:21.048789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:21.049254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:21.050196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:21.050721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:21.052819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae01364-c8a2-470c-a685-9931a45c8124 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:21.066329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 211/417] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:21.074854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:21.172370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:21.198030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698629f-45df-4362-aa6e-9c3908cfd34e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:21.254733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf765f8-54ac-4a0d-914e-baeff3b2247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:21.255934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf765f8-54ac-4a0d-914e-baeff3b2247a None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:21.256208 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf765f8-54ac-4a0d-914e-baeff3b2247a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:21.256482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf765f8-54ac-4a0d-914e-baeff3b2247a None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/94d217e156e944c3ba7dbbab90344e7a/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:21.276476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf765f8-54ac-4a0d-914e-baeff3b2247a None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=94d217e156e944c3ba7dbbab90344e7a, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:21.277957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf765f8-54ac-4a0d-914e-baeff3b2247a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:21.352481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 207/418] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:21 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/94d217e156e944c3ba7dbbab90344e7a/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:21.575803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ab88-4960-429e-8584-b9af06c22fc9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:21.576304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ab88-4960-429e-8584-b9af06c22fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:21.576304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ab88-4960-429e-8584-b9af06c22fc9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:21.577947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 212/419] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:21.583760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:21.584045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:21.584322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:21.603453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:21.604818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:21.684375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 208/420] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:22.015127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ab88-4960-429e-8584-b9af06c22fc9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:22.027410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:22.130944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ab88-4960-429e-8584-b9af06c22fc9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:22.165511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:22.166157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:22.166436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:22.166702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:22.178012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:22.182730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:22.183577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:22.184333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 213/421] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:22.189667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:22.292071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:22.341812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06244-d215-4440-abec-c6bcebe7ff72 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:22.384160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:22.384763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:22.385040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:22.385313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:22.385997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:22.386303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:22.387742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:22.401474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 209/422] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:22.406626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:22.508950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:22.546188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32319a-a9cf-418c-8093-df913cadb186 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:22.577772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:22.578414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:22.578650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:22.578918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:22.591011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:22.592466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a0fdcbbc-9289-401c-9ff1-0c52e37631b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:22.606854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:22.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:22.608554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:22.608554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:22.608554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:22.608554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 214/423] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:22.614698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:22.617117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d82491-49dc-400a-b9d3-c0901ef4d132 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:22.617665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d82491-49dc-400a-b9d3-c0901ef4d132 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:22.618136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d82491-49dc-400a-b9d3-c0901ef4d132 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:22.619960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 215/424] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:22.625213 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:22.625768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:22.626261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:22.645526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:22.647711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:22.735612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 216/425] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:22.821245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d508-f10c-4d4c-8e6e-cc39e14e4b2e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:22.841023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:22.861272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:22.861908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:22.862190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:22.862463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:22.863102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:22.863407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:22.865306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:22.880368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 210/426] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:22.888061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:22.936976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:23.006705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d3d26-3014-486c-9519-5b2fae39edff None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.040823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.041444 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.041748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.042018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.048984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:23.050440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:23.070928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:23.071855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:23.072750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 217/427] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:23.077617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.160912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.247957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5b4c8-297c-482c-ab73-7c2bc6fdd76d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.306840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.308259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.308715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.309156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.310089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:23.310579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:23.312184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d6454-1a9e-4a17-af6c-82f0e098cbb1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:23.331198 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 211/428] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:23.332666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305502-54c8-44b5-b35b-3a53b6920f95 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.333138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305502-54c8-44b5-b35b-3a53b6920f95 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.333650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305502-54c8-44b5-b35b-3a53b6920f95 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.335305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 212/429] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:23.336623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305502-54c8-44b5-b35b-3a53b6920f95 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.353130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c20894-815b-48d3-afbc-a48f04385e47 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.363577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:23.382277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:23.390930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b058a-5bcd-4636-b5bb-dafaef8556ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.392135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b058a-5bcd-4636-b5bb-dafaef8556ca None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.392750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b058a-5bcd-4636-b5bb-dafaef8556ca None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.393094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b058a-5bcd-4636-b5bb-dafaef8556ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.408188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b058a-5bcd-4636-b5bb-dafaef8556ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bb6b058a-5bcd-4636-b5bb-dafaef8556ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:23.415928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:23.417007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:23.418015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:23.421571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 218/430] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:23.421571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.421571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.421813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.444218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:23.446796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:23.454920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305502-54c8-44b5-b35b-3a53b6920f95 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.491635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.492263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.492539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.492807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.504381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:23.506014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:23.523273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:23.524233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:23.525070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:23.525070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:23.525070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:23.529226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 213/431] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:23.530265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.539460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 219/432] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:23.540671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.652458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:23.656893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d45079-9058-441d-980a-0d3b22bad5ee None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.677942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:23.690161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956287b5-67f4-4b90-bef3-c71bf1696bfe None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.694507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.695385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.695861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.696336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.697164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:23.697698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:23.699328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98e9d-09ef-4c94-9453-6532d704ff97 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:23.713116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 220/433] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:23.714954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625b979-7d92-4814-a86c-7e607c981949 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.715757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625b979-7d92-4814-a86c-7e607c981949 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.716270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625b979-7d92-4814-a86c-7e607c981949 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.718357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 221/434] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:23.719290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625b979-7d92-4814-a86c-7e607c981949 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.732470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.733075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.733350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.733651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.734320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:23.734696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:23.736054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440d7b-6d89-4b11-b5a1-7f2ae1308e2a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:23.744655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 214/435] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:23.749837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.749837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.749837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.764928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:23.766969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:23.841228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 215/436] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:23.843310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.889778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625b979-7d92-4814-a86c-7e607c981949 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.924161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:23.924988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:23.925430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:23.925868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:23.932603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:23.934204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:23.945887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:23.946885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:23.947852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:23.952357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:23.954333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 222/437] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:23.955165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:23.972945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c60087-1f05-4ae7-917a-54b3d5bdb586 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:23.977576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.011729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.012587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.013067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.013485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.024795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.027872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:24.046561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:24.047717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:24.048711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:24.048711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:24.048711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:24.050757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 216/438] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:24.051838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.066314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a633-2ca2-429d-bd34-75b5323fea6f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.111061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.112708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.113184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.113847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.129678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:24.137897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:24.138940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:24.139892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:24.143176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 223/439] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:24.144103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.172270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d34d5c-9245-446d-b8d5-291f6bc59ab7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.206046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.206900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.207177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.207448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.208128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:24.208455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.209908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.211488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.224634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 217/440] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:24.224634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.229367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.248242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c826238-f045-4f1b-9885-3647ae9fe60a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.281292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.281920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.282189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.282452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.283074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:24.283370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.284710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.296697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 224/441] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:24.297630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.326159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9fc55-e2ce-447a-b5bb-d851d306ff28 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.357867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf9c56-de84-4dde-a761-06e2c602f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.358484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf9c56-de84-4dde-a761-06e2c602f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.358758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf9c56-de84-4dde-a761-06e2c602f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.359027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf9c56-de84-4dde-a761-06e2c602f5f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.369679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf9c56-de84-4dde-a761-06e2c602f5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ebbf9c56-de84-4dde-a761-06e2c602f5f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:24.374369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:24.375413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:24.376371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 218/442] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:24.377155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085594-243e-4d6c-825f-6fdc88e37335 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.377155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085594-243e-4d6c-825f-6fdc88e37335 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.377511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085594-243e-4d6c-825f-6fdc88e37335 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.383457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 219/443] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:24.384224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19085594-243e-4d6c-825f-6fdc88e37335 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.397025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ecef4-2e59-4a0b-aca1-3a7a5b715047 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.429492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.430106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.430382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.430652 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.431301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:24.431599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.432961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.439073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.440577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 225/444] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:24.441362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.444479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.484608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19085594-243e-4d6c-825f-6fdc88e37335 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.518440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe16a92-ba63-4b54-b962-0d661661e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.519080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe16a92-ba63-4b54-b962-0d661661e0e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.519355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe16a92-ba63-4b54-b962-0d661661e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.519627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe16a92-ba63-4b54-b962-0d661661e0e8 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/c39f6ddafe58479a8dcf5161294a8b19/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.533187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe16a92-ba63-4b54-b962-0d661661e0e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=c39f6ddafe58479a8dcf5161294a8b19, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.534676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe16a92-ba63-4b54-b962-0d661661e0e8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.537836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1491-9117-45e2-aa17-5923e68d8f5a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.569621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.570227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.570500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.570765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.577861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.579279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:24.590169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:24.591197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 226/445] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:24.592290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.603125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 220/446] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:24 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/c39f6ddafe58479a8dcf5161294a8b19/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:24.604522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.607938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.607938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.624934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:24.626377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:24.664110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.704860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 221/447] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:24.706112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.721332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1380-63e3-4229-ba68-ddb0528fcd33 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.754657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.763858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.764615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.765102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.765476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.766280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:24.766939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.768600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.779734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 227/448] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:24.780768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.848021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fc53f-8cc5-42ef-86df-f13c2d61a276 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.885240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.885902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.886237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.886509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.899407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.900010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196020f-0f50-4222-a521-ebad992e9bb3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:24.900898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:24.917158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:24.918240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:24.919232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:24.919232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:24.919232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:24.919232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 222/449] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:24.923618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:24.928748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:24.939781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:24.940507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:24.945965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:24.945965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:24.945965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:24.945965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:24.945965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:24.970692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 228/450] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:24.971737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.017347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.033484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407a9c7-a316-4590-9cc3-007115efed14 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.068731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.069802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.070083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.070503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.080871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0f0bb-b8d5-4846-8a20-cfc58bec8dfa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.081087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.082557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:25.096868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:25.098110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:25.100015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:25.100015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:25.100015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:25.100015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 223/451] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:25.103860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.122728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.123333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.123612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.123883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.124517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:25.124818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.126214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.142015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 229/452] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:25.142015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.187740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.209195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778e90-1139-4348-a0f1-eb056f1c9223 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.249839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ee42-b7d1-4734-b743-95611d72d5a4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.251187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.251881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.252239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.252580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.261108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.285403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.286064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.286963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.287550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.297921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:25.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:25.304318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:25.305290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:25.306649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 230/453] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:25.307331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.335510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.336955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.416342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fe02c-e0db-4c60-a53b-5d163e4e66a9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.417986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.436856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 224/454] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:25.437964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.454893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.455571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.455854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.456124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.456756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:25.457057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.459022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.471802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 231/455] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:25.472867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.481155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.542480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb6954-4b09-44de-b78e-36d8f3a0704f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.579064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98b3d-d9a0-4804-ab7e-341af9f136c9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.583437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.584622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.584972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.585316 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] PATH_INFO: `/v3/users/glance` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.592538 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.594087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:25.605447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:25.606343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:25.607203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 225/456] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:25.607758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.619964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.620556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.620831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.621097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.621880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:25.622175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.623651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.637207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 232/457] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:25.637207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.662679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.708407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.712344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ba26-639b-4dc9-a37f-6414086e60be None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.747005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795717ac-3dc9-4a38-a3de-fd2ce1e4ff51 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.747504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.748072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.748412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.748791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.760371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.762501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:25.780814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:25.781919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:25.782734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:25.782734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:25.782734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:25.782734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 226/458] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:25.782734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.785574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.786325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.786556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.786938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.795946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.797693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:25.810918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:25.811770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:25.812619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 233/459] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:25.813152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.893814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74803144-4eba-45b2-9e85-074cee975543 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.903586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.919299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865be14-a1f1-4dbd-a00a-b0fe58cde598 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:25.937423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.938051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.938328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.939064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.940528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:25.940837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.943914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.954162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:25.954784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:25.955059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:25.955332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:25.961389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 227/460] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:25.962924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:25.966117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:25.967562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:25.975410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:25.981627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:25.982496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:25.983869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:25.983869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:25.983869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:25.983869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 234/461] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:25.983869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.083665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ff2f1-6c7e-4566-a085-def9ed232466 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.087330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f88688-cfe1-4e00-8d69-e5ba154a3a92 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.120582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.121469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.121996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.122466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.123273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:26.123640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.123876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.124237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.124513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.124785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.125503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:26.125834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.126169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.127231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.131165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.137575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 228/462] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:26.138362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.155388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 235/463] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Nov 2 07:25:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:26.155388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.219751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.260420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966c55-df61-4bfd-bdd7-d14ca9612fe5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.262165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e3d4-1769-4c2f-83bd-41e421a872fa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.297171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.297655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.297805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.298081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.298348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.298625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.298977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:26.299064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.299274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.299492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.300618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.314640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 236/464] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:26.315420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.376684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.377184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.378326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.426441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b29ee6-77c5-4681-8f73-3e3038a079fd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.447050 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.463745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.464463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.464813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.465087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.471832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.473266 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.488093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 229/465] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:26.488093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:26.488307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:26.489052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:26.489969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 237/466] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:26.492022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.590490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a134e-4a5a-45f5-bb29-bfc331a249f0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.596867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1311be-2e01-4dfe-af3e-bf38e7bd0e7f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.611441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.625325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.625962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.626248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.626507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.634004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.635220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.635639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.636044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.644393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.646626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:26.658157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:26.659187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:25:26.660112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:26.663445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 238/467] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:26.663655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.664528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.705095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.706772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.774024 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc1f5-2dc2-493d-a3e7-916108ddbc46 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.808391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.809012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.809291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.809588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.810475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 230/468] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:26.811311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.820891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.822352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:26.836533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:26.837561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:26.838579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:26.838579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:26.838579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:26.838579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 239/469] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:26.838579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.868132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.876075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:26.908434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561fe0-3cb8-4708-a9e5-52a80a2b67ec None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.937880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f21c-bc91-4e34-94e3-36268bbb3bec None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:26.940910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.941505 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.941809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.942080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.943286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:26.943588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.945023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110309eb-c33a-4268-98ac-f71347d618cf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.956079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 231/470] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:26.957216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc5899-c5d5-4f03-8a57-55d0c361a859 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.957496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc5899-c5d5-4f03-8a57-55d0c361a859 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.957796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc5899-c5d5-4f03-8a57-55d0c361a859 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.959539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 232/471] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:26.960228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc5899-c5d5-4f03-8a57-55d0c361a859 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:26.976579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:26.977286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:26.977698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:26.978030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:26.978844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:26.979203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:26.980614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:26.997191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 240/472] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:26.998121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.062900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc5899-c5d5-4f03-8a57-55d0c361a859 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.079001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.088931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.094845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aadd8-b370-4422-838b-7c0b544325a0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.096385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.097006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.097287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.097581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.107795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.109226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:27.123386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:27.124401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:27.125414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:27.125414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:27.125414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:27.125414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 233/473] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:27.126270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.134528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.135138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.135423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.135699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.136334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:27.136636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.138037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19984004-b243-41e0-9efc-c756049ea2d7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.149947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 241/474] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:27.151079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.151361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.151635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.169011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:27.170151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:27.228362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051124c7-9e30-4294-bb04-d2dafc12f28b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.242854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 242/475] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:27.243690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.268011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.268606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.268916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.269161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.269905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=0297ece9087142c1987312d97a6a3867) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:27.270214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.271683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.277679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 234/476] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/role_assignments?user.id=0297ece9087142c1987312d97a6a3867&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:27.278515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.342414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.344784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.375460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b2b3-814c-453b-b063-056322af21f3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.414165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289f12-e40e-4078-bef9-05fc3733eb75 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.421680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.422226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.422502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.422783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.463679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.464828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.465254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.466553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.467351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:27.467834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.469405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.486300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 235/477] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:27.487520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.508162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.509650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.589446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.604774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58677-968b-47b5-bdb8-0536eba4baa4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.607963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.620057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 243/478] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:27.620057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.646004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.646908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.647322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.647976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.655485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.656924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:27.668695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:27.669572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:27.670400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 236/479] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:27.671413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.725333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109bc8f-45c9-42b6-bab1-fc56ac6adf7e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.764673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.765323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.765623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.765947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.774623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.776363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.779333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196305b-52e0-4a62-85d3-d4b0da2572a2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:27.789568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:27.790415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:27.791228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 244/480] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:27.791665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.821056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.821741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.822018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.822284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.834699 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:27.836996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:27.839870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:27.840797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 237/481] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:27.842164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.872491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:27.913725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea9a73-be61-4220-89b5-d893c5b7e64b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.947215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2d68-31c7-4911-ab0d-af9fc5f899a3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:27.951259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.951879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.952154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.952422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.964724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.966175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:27.982500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:27.983360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:27.984251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:27.984251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:27.984251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:27.984251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 245/482] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:27.985609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:27.986199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:27.986477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:27.986747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:27.987433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:27.988052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:27.988804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:27.989312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.007537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 238/483] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.008731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.077244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.092773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c35261-8624-40b2-aa15-85d00c5c748c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.100872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.117905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a7334-3e82-4157-a61f-f0049bf02045 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.127807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.128412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.128691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.128964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.129678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.130014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.131480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.143988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 246/484] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.145170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.159286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.159888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.160182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.160441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.161103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.162094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.163459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.171650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 239/485] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.172240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.268243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9486c-3229-4bd2-a251-1a0b3515982c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.283632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f62808-7fc7-4650-9607-11a65f4d3e8a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.303366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.303975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.304235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.304508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.305134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.305428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.306806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.318834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.319108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 247/486] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.319431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.319706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.320054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.320749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.320853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=0d3201a663964573be66ab4ad0d13b8b) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.321059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.322489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.333162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.333878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 240/487] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/role_assignments?user.id=0d3201a663964573be66ab4ad0d13b8b&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.334826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.359642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.447669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c48d-d975-4f6e-bbcd-5fd9a862b27a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.476375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a9d2-d8df-4fce-af89-3be74fb87f93 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.499552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.500163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.500440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.500986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.501745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=4f95b0b156df4f26a498c8d332cc100a) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.502051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.504383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.512059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 248/488] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/role_assignments?user.id=4f95b0b156df4f26a498c8d332cc100a&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.512951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.519554 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.520618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.521595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.522084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.535040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.536944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:28.554441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:28.555379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:28.556189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:28.556189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:28.556189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:28.556862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 241/489] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:28.563177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.600081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.636155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1e65d-3b85-4c97-8960-6c572fdcceb5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.641984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.682796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.683803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.684275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.684765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.686317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27104804-1fec-48e6-a990-fa740db63d31 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.696042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.699467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:28.715494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:28.716378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:28.717598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:28.721870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 249/490] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:28.729796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.736966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.737641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.737888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.738154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.740354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.740744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.742059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.761297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 242/491] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:28.762223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.851569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ac107-6ca1-4b13-8df2-9634333796fa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.889534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.893706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2d68f-e7c1-4cb4-a281-4000b59a5e65 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:28.897238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.898228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.898709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.911504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.911504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:28.911504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.911504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.917702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 250/492] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:28.923475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:28.928446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.948745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:28.949262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:28.949536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:28.949830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:28.965510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:28.967667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:28.987522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:28.988477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:28.990706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 243/493] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:28.996892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:29.097685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e94a3-e85c-463b-b357-9a96b7de7ce7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:29.156106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:29.156621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:29.156893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:29.157158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:29.157919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=94d217e156e944c3ba7dbbab90344e7a) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:29.158227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:29.159691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:29.172826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 251/494] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/role_assignments?user.id=94d217e156e944c3ba7dbbab90344e7a&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:29.188177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb09e08-1534-4721-8034-aa5c1dc1e8c6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:29.259056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:29.259701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:29.259977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:29.260248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:29.260998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:29.261301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:29.262817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a78120-1553-410e-8c2a-55a509eb260a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:29.295616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 244/495] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Nov 2 07:25:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:29.301247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:29.373922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:29.424469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d71e-dc21-4d99-ac1a-a24b3e25a9d0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:29.459572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:29.460180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:29.460456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:29.460726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:29.539719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:29.541174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:29.603187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:29.658786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44991f0-a525-4587-824b-4d2344ad96f7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:29.659293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44991f0-a525-4587-824b-4d2344ad96f7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:29.659367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44991f0-a525-4587-824b-4d2344ad96f7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:29.660977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 245/496] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:29.662597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 252/497] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:25:29.668005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:29.668322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:29.668451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:29.668611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:29.699253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:29.700415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:29.770972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:29.792948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854e8f0-f942-4733-a8a5-fd9810d4b692 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:29.828167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 246/498] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:29.838936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:29.839567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:29.839845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:29.840119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:29.861154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:29.862621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:29.887606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:29.889763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:29.892040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:29.892040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:29.892040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:29.892040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 253/499] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:29.898200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.049528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b51d-8c98-49ce-93c2-dec01a9617d2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.103164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:30.103776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:30.104057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:30.104323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:30.104968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:30.105269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:30.106742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:30.123463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 247/500] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:30.129285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.147321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:30.200063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.264430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:30.289977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313b3aa-4a81-4972-b5c7-42872ec9967f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.357960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98618e0-931c-4cf0-b8d0-e12494e246f8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.374062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:30.374682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:30.374952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:30.375215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:30.390026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:30.394289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:30.414084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:30.414984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:30.416647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 254/501] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:30.422932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.434486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:30.435124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:30.435404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:30.435674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:30.446347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:30.451987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:30.452854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:30.453843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 248/502] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:30.459309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.576260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:30.607641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0d1b-a008-4c93-b917-6ab1a8e2dd03 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.618238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:30.647404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:30.648495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:30.648978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:30.649426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:30.650279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:30.650755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:30.652298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:30.664391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 249/503] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:30.666240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b9cf-7c4d-46f0-b24d-38c1afd37934 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.674056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.712254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:30.713197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:30.713749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:30.715372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:30.716248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:30.717491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:30.719918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:30.745608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 255/504] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:30.751559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.836145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75fe21-bc4f-4713-82d7-806b54eeceb1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.893919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:30.894899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:30.896017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:30.898130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:30.920849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:30.923547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:30.942917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:30.943971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:30.944831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:30.944831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:30.944831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:30.947217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 250/505] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:30.951966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33221a3-1376-4e7b-b280-a44c7f83eb0c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:30.954378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:30.965877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:31.007328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:31.029598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:31.032466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.032752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.033081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.033903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=c39f6ddafe58479a8dcf5161294a8b19) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:31.034210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:31.035642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406d81-7af6-467a-862e-90164bed0c37 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:31.047114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 256/506] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/role_assignments?user.id=c39f6ddafe58479a8dcf5161294a8b19&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:31.144448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c297d7-7a74-4128-8eab-790fb91173fa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:31.160315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe5eb-81dc-4022-817a-b8e81beb5560 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.160648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe5eb-81dc-4022-817a-b8e81beb5560 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.160877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe5eb-81dc-4022-817a-b8e81beb5560 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.163149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 257/507] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:31.169252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb4bf-b4a0-437a-b163-e87d16e01b76 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.169613 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb4bf-b4a0-437a-b163-e87d16e01b76 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.169829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb4bf-b4a0-437a-b163-e87d16e01b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.207269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-513cb4bf-b4a0-437a-b163-e87d16e01b76 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:31.209758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-513cb4bf-b4a0-437a-b163-e87d16e01b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:31.215710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:31.216326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.216602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.216870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.217513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:31.217832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:31.229535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:31.252480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 251/508] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:31.258496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:31.304696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 258/509] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:31.306019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bb43-2ee4-4f9e-b588-ecc6d6919164 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.306375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bb43-2ee4-4f9e-b588-ecc6d6919164 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.306725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bb43-2ee4-4f9e-b588-ecc6d6919164 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.308274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 259/510] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:31.314915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.315268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.315722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.336478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:31.339851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:31.341096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:31.388968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc4d52-125d-4ea5-a387-74dff7c031ec None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:31.425878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:31.426427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.427298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.427593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.429951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 260/511] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:31.443474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:31.444924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:31.461496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:31.462479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:31.463808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 252/512] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Nov 2 07:25:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:31.468639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:31.530352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:31.588486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a4fe-5d34-4484-9758-3727f5b9160e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:31.636591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:31.637572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.638114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.638581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.639494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:31.639987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:31.641893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:31.666437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 261/513] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Nov 2 07:25:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:31.671177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:31.707395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:31.795906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236de5a-e31d-4aa9-9abd-7c39ef5f1042 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:31.819338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:31.833632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:31.834449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.834778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.835109 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.837352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc01c72-63c9-4ae3-8915-49ac5d31b65e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:31.850242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:31.850885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:31.852412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:31.867970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:31.868976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:31.869955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:31.869955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:31.869955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:31.869955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 253/514] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:31.870632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:31.882938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:31.884029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:31.884502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:31.885096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:31.899702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:31.901509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:31.919025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:31.919991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:31.920819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:31.920819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:31.920819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:31.927871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 262/515] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:31.929487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:31.988778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa0f9-b3a3-4b1f-be37-05f9d407c690 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.022780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.023402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.023686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.023956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.024533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.026087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:32.038395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:32.039364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.040172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 254/516] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Nov 2 07:25:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:32.041435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.049010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f758-b52c-4091-b027-36110869fb90 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.083588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.084682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.085200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.085477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.085781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.086419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:32.086842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.088227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2b65-52fc-4131-8a25-9a7e1a7c8181 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.101322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 263/517] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:32.107060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535c18-abec-4900-86a8-834395c4fa9d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.107387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535c18-abec-4900-86a8-834395c4fa9d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.107607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535c18-abec-4900-86a8-834395c4fa9d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.109783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 264/518] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:32.109783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535c18-abec-4900-86a8-834395c4fa9d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.133375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.146487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ee12-3e63-4905-a8ce-82fe0e5c8b19 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.179977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.180630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.180906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.181175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.181885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:32.182184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.183570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.201092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 255/519] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:32.201092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.229289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535c18-abec-4900-86a8-834395c4fa9d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.266495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.267032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.267307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.267594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.268191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:32.268491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.269869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe26dfe-6715-4a87-9d78-da59f2c45e24 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.280062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 265/520] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:32.280062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.280062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.280062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.296196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:32.297403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:32.302897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.305949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba0eea-30a0-49f3-909d-0988f1b6e5d2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.340270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.341287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.341608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.341891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.349258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.350812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:32.362393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:32.363242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 256/521] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:32.364837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.380619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 266/522] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:32.380619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.388498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.490214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603682c-31b0-49e1-aa1e-e256d5076128 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.498974 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff255e-d726-4fd1-a3f4-ed8a3443a699 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.526763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.527285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.527559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.527994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.528616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:32.528911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.530294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.534084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.534688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.534968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.535244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.535918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.536231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 267/523] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:32.537070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.537444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.633014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.644220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 257/524] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:32 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:32.658127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111fe0-2f00-4eeb-bf0f-1ec5319a861f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.658477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.696079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.706275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.715649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.715649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.715649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.715649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:32.715649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.715649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.725167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 268/525] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:32.730828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.823978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3079-69e0-4b54-b791-a54419c63536 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.854006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d60e-751d-4668-a6b9-bccc5d6d0fbb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.868508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.869136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.869414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.869720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.870304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.871672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:32.880789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:32.881800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:32.882606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 258/526] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:32.889160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.892341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.893194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.894422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.894760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0297ece9087142c1987312d97a6a3867/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.896825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=0297ece9087142c1987312d97a6a3867, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.898398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.985702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.993181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:33.008099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 269/527] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:32 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0297ece9087142c1987312d97a6a3867/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:25:33.009303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89556-1205-47c8-adf2-afc2442ebf49 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:33.059330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:33.059939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:33.060273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:33.060545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:33.061224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:33.061528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:33.063008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce7f1-5747-43fa-9144-a7a3f1176deb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:33.068366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 259/528] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:33.073840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:33.245318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98e0f0-2110-43d8-a52d-dcfd7de810f7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:33.280776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:33.281761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:33.282260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:33.282726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:33.283540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:33.284047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:33.285682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27be71-e41c-409a-abb4-fec1c0b29eee None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:33.291232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 270/529] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:33.572412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dbe9e-512c-43b2-9ee9-097e9c9f40a1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:33.572604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dbe9e-512c-43b2-9ee9-097e9c9f40a1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:33.572875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dbe9e-512c-43b2-9ee9-097e9c9f40a1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:33.574502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 260/530] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:33.579793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:33.580368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:33.580848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:33.600889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:33.602475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:33.664664 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:33.679641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 271/531] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:34.048823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dbe9e-512c-43b2-9ee9-097e9c9f40a1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:34.171201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dbe9e-512c-43b2-9ee9-097e9c9f40a1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:34.213875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:34.214504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:34.214779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:34.215047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:34.238131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:34.243892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:34.244788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:34.245658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 261/532] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:34.255234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:34.441407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f334e1-34b3-4849-bf64-ad141552d2cb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:34.491077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:34.491677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:34.491956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:34.492225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:34.492879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:34.493174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:34.494627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:34.509021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 272/533] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:34.518662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:34.526965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:34.677787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c6e77-18ce-43b5-94f4-13f7577cfc43 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:34.722303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:34.722852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:34.723139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:34.723435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:34.738714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:34.740688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:34.759034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:34.761303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:34.763487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:34.763487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:34.763487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:34.766336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 262/534] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:34.770705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:34.896357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:34.954312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584dae5-e9e7-4033-91ac-0ef4553d6459 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:35.007686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:35.008217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.008494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.008766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.009412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:35.009742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:35.011106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:35.028808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 273/535] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:35.034321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:35.133605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:35.202927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd442f9-ba01-45a1-9f7e-0735ac67179c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:35.262295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:35.262847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.263123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.263387 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.276399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:35.277868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4d331f8d-3ccf-4704-bf14-5d350a59c22c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:35.295496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:35.297875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:35.300171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:35.303626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 263/536] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:35.310657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:35.316500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887569e-c71c-4a4d-977e-d3340fcfd1ef None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.316500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887569e-c71c-4a4d-977e-d3340fcfd1ef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.319027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887569e-c71c-4a4d-977e-d3340fcfd1ef None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.319027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 264/537] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:35.324554 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f761-0e4c-48e9-a39c-2dfe7192fb09 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.325092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f761-0e4c-48e9-a39c-2dfe7192fb09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.325597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544f761-0e4c-48e9-a39c-2dfe7192fb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.347337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d544f761-0e4c-48e9-a39c-2dfe7192fb09 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:35.348973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d544f761-0e4c-48e9-a39c-2dfe7192fb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:35.462597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 265/538] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:35.467820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e09ca-d5e9-4327-9e71-5546abf4827f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.467820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e09ca-d5e9-4327-9e71-5546abf4827f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.467820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e09ca-d5e9-4327-9e71-5546abf4827f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.471800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 266/539] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:35.471921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1e631-9792-4312-a281-0a5d39e2973a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.472133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1e631-9792-4312-a281-0a5d39e2973a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.472401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1e631-9792-4312-a281-0a5d39e2973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.492582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7ed1e631-9792-4312-a281-0a5d39e2973a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:35.493794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7ed1e631-9792-4312-a281-0a5d39e2973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:35.519426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e4d2d-90d5-4ad9-bc63-ac46427cc8d2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:35.545188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:35.577965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:35.585888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:35.586495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.586769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.587039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.587762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:35.588061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:35.589568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:35.619599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 274/540] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Nov 2 07:25:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:35.625611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:35.627289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 267/541] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:25:35.775164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0aa24-8a1c-46e1-bd1d-71a7aafc939d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:35.785131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e29f6-ab2a-4b30-85a3-66312f51b0bd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.785416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e29f6-ab2a-4b30-85a3-66312f51b0bd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.786257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e29f6-ab2a-4b30-85a3-66312f51b0bd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.789821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 268/542] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:35.794317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.794600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.794871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.815181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:35.816347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:35.841526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:35.842470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.842930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.843384 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.866695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:35.868166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:35.893846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:35.894828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:35.896345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:35.896345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:35.896345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:35.896345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 275/543] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:35.896345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:35.913959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 269/544] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:35.915846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:35.924554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.027185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48406-7e69-406b-859f-9a75caeac8a6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.056812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59f44-b762-4300-a7ed-0f428028bd06 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.063638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7417b-c93d-4b66-84cc-97a85f8b9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.064245 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7417b-c93d-4b66-84cc-97a85f8b9a50 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.064379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.064520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7417b-c93d-4b66-84cc-97a85f8b9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.064780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7417b-c93d-4b66-84cc-97a85f8b9a50 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.065426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7417b-c93d-4b66-84cc-97a85f8b9a50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.066809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7417b-c93d-4b66-84cc-97a85f8b9a50 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.093088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.093995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.094502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.094817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.095766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.096072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.097427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.108506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 270/545] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.109281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.181105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 276/546] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:25:35 2022] POST /identity/v3/services => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:36.182174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a171ca5-2951-4bfc-9888-c51cd357480e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.182457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a171ca5-2951-4bfc-9888-c51cd357480e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.182724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a171ca5-2951-4bfc-9888-c51cd357480e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.188722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 277/547] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:36.188722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a171ca5-2951-4bfc-9888-c51cd357480e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.220622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ea987-b80d-4029-ac3f-7e77e65394d8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.269785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d3eb9-c06e-4bdc-aed9-523e66333444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.270425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d3eb9-c06e-4bdc-aed9-523e66333444 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.270700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d3eb9-c06e-4bdc-aed9-523e66333444 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.270968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d3eb9-c06e-4bdc-aed9-523e66333444 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.282943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d3eb9-c06e-4bdc-aed9-523e66333444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c29d3eb9-c06e-4bdc-aed9-523e66333444 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:36.288298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.289271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:36.290144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 271/548] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.291334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.291433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.291683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.306054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.310880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:36.312102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:36.324850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a171ca5-2951-4bfc-9888-c51cd357480e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.330958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.362261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.362885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.363156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.364860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.371919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.373393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:36.385901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.389818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 278/549] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.390675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.391496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 272/550] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:25:36.391496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.502165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326b4a0-63fe-40b0-aec1-89548ea4e64e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.523703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a87b5-adbe-443a-b70f-6c8d1387b01e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.550457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.551891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.552557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.552958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.553795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.554352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.556381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.560000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.560627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.560906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.561180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.565810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 273/551] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.566792 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.577158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:36.583007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.583920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:36.584720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:36.585320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.585909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 279/552] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.586358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.594489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.687551 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8489470-dce6-4376-a03b-97f40a4385ef None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.708414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfc14-0770-45fe-9569-5739f951c541 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.724187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.724791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.725066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.725335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.726054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.726359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.727830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.740992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 274/553] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.741851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.749718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.750355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.750630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.750900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.761638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.763064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:36.776842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.782484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:36.783415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:36.783415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:36.783415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:36.783415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 280/554] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.783415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.840821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.867720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.889871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecf32d-9eb4-4abc-9c5a-7d6d021b9efc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.893255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380d40-eb5f-475f-89d6-97fa1a70902c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.928517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.929115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.929392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.929684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.930328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.931383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.931687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.931981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.932259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.932527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.933179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.933477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.934972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.943339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 275/555] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.949587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.004252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 281/556] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:25:36 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:37.005364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.059007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271b57-5cc8-4fbb-b42c-359f2e51b0e0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.102139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.108090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.108881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.109235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.109777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/c39f6ddafe58479a8dcf5161294a8b19/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.112162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=c39f6ddafe58479a8dcf5161294a8b19, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.116436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.138658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ff36c-fef2-4bd1-822c-6968e370a5a7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.156676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.178250 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.178986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.179271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.179546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.180206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:37.180512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.181945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.202231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 282/557] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:37.202231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.204588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 276/558] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:36 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/c39f6ddafe58479a8dcf5161294a8b19/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:37.212134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.346299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3558c-9322-49ee-96b9-e05e5913ca7e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.388997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fa05a-974c-4f1d-9f22-71d2037b7487 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.395957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.396610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.396887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.397156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.412012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.413609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:37.433287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:37.434332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:37.435206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:37.435206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:37.435206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:37.435206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 283/559] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:37.436019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.436813 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.437220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.437667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.442546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.449826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.451436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:37.467983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:37.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:37.470086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 277/560] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:37.477998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.484602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.561916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.581552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71a411-419d-43df-b2d6-2c11bb86733c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.619714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.620331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.620611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.620888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.621554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:37.628672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.628672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.636394 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 284/561] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:37.642254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.691472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119db28b-4c7a-40d6-b137-26944794da89 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.741924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.752527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e46d1c-921a-454b-ba51-db04c0083269 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.800813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.802004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.802282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.802557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.804407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.805007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.805285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.805569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.806455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:37.806763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.809533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.822509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.824100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:37.846919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:37.847881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:37.848829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 285/562] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:37.850270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 278/563] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:37.855815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.856867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.979303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335065d-6270-4562-a17d-0887f59c1f54 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.017924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.018864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.019243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.019620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.031905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.033485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.042914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:38.050873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:38.052050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:38.052972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:38.052972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:38.052972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:38.054328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 286/564] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:38.059924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:38.111482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5faf20-1bb1-421a-9ff6-dcc343cc3a4f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.139823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:38.173169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fcb83-6a4b-45d0-ba98-508a36eccc59 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.212010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.212742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.213090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.213457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.214183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:38.214648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.216023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.232312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 287/565] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:38.237530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:38.262274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.262901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.263186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.263441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.264172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:38.264469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.266177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.315461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 279/566] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:38.321762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:38.329931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:38.346358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362338ec-2811-4ae6-852b-45be1f2a3f15 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.384632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.385278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.385580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.386529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.395475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.397291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:38.412075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:38.413018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:38.413942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:38.414367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 288/567] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:38.419520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:38.531338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc7c7-3b10-4bbb-96db-798ff9a1856f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.577909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:38.601966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.602568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.602843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.603115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.603801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:38.604100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.605553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.623109 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ea891-8991-4d25-b17e-fe90f4016240 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.628326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 289/568] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:38.634055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:38.670470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdd019-828c-480d-914b-d3314919d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.671112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd019-828c-480d-914b-d3314919d58c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.671369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd019-828c-480d-914b-d3314919d58c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.671645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd019-828c-480d-914b-d3314919d58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.707288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:38.734652 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b9d8-84ee-4298-9057-0ba52a545360 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.742347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdd019-828c-480d-914b-d3314919d58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.743807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdd019-828c-480d-914b-d3314919d58c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.768662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e7bdc-8969-4b78-b7f6-40a6fca70ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:38.769370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7bdc-8969-4b78-b7f6-40a6fca70ba3 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.769677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7bdc-8969-4b78-b7f6-40a6fca70ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.770506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e7bdc-8969-4b78-b7f6-40a6fca70ba3 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/659ffab6d37f4f1aaa7cc68bcfdcc041/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.785484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e7bdc-8969-4b78-b7f6-40a6fca70ba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=659ffab6d37f4f1aaa7cc68bcfdcc041, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:38.787404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e7bdc-8969-4b78-b7f6-40a6fca70ba3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:38.850443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 280/569] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:38.851707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf797c-87e4-47d4-be89-a4a0de63cb20 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.851997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf797c-87e4-47d4-be89-a4a0de63cb20 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.852275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf797c-87e4-47d4-be89-a4a0de63cb20 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.857638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 281/570] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:38.858432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf797c-87e4-47d4-be89-a4a0de63cb20 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:38.905913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 290/571] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:38 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/659ffab6d37f4f1aaa7cc68bcfdcc041/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:25:38.907460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:38.907750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:38.908306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:38.938247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:38.939890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:38.941133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:38.983989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf797c-87e4-47d4-be89-a4a0de63cb20 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:38.989919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:39.030916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.032085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.032988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.033493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.048223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.050930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.054592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 291/572] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:39.077273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:39.090071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:39.090956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:39.090956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:39.090956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:39.090956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 282/573] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:39.092876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:39.228826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e691e2-b9e6-473a-b9ca-fc5ab3be1f97 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:39.265308 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.266246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.266532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.266806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.267455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:39.267758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.269135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7f5a-c338-4c0f-bffa-b1ae48717f21 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.281836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 292/574] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:39.287110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:39.423896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad68d6-caac-46f4-9e55-aaf9c1ac8c82 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:39.449918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:39.468648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.472148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.472148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.472306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d73d8-0614-4085-a331-6b259c4a12d3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.472306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d73d8-0614-4085-a331-6b259c4a12d3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.472306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d73d8-0614-4085-a331-6b259c4a12d3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.473261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 293/575] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:39.473450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.478397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.478681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.478959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.498874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.500332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.508013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:39.509224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:39.516786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:39.517704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:39.518565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 283/576] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:39.519545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:39.528739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:39.600772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 294/577] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:39.601880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:39.665616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433adb6-9ccf-43f9-be9a-d3917fdf4c6e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:39.721847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4631833-eb64-40c9-b3b1-b39f5863b362 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:39.747186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.747826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.748104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.748384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.748991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.750357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.763299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.764451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.764952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.765447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.766618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:39.767233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.769002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ec3be-a7b9-4fc0-86b7-cf724c8142de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:39.769470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:39.770547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:39.771374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:39.775504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 284/578] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:39.776669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:39.799335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 295/579] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:39.801144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f318b-f8b3-42c2-acb1-ea50ed12d36c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.802177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f318b-f8b3-42c2-acb1-ea50ed12d36c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.803091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f318b-f8b3-42c2-acb1-ea50ed12d36c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.804756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 296/580] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:39.809456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f318b-f8b3-42c2-acb1-ea50ed12d36c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:39.826437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:39.836718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:39.896645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b54f-212d-47ba-b8d9-dbc5ef2ae2c2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:39.933789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.934393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.934715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.934989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.935710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:39.936013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.937478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d997f3-e7fa-4660-ba1f-7645fc9e5902 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.942780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 285/581] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:39.943934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.944269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.944543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.946686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f318b-f8b3-42c2-acb1-ea50ed12d36c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:39.963717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:39.964894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:39.984830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:39.985348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.985648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.985913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.986623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=0297ece9087142c1987312d97a6a3867) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:39.987187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:39.988451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:39.997799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 297/582] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/role_assignments?user.id=0297ece9087142c1987312d97a6a3867&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:39.997799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.052086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 286/583] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:40.059117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.087204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.117820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2f8b-5236-40f7-ad7f-49df255556b9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.141156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.156892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.157517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.157827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.159161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.159161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.159161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.161221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.166215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 298/584] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Nov 2 07:25:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:40.172544 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.257047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f797e9-732c-4fc3-be6d-951d97c3b844 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.287997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05487f-08e2-414c-96da-58e0b48bed5e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.295857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.296485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.296758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.297024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.297768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.298971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:40.308360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:40.309349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:40.310264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:40.311676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 287/585] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:40.316672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.340255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.340861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.341136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.341401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.342129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] RBAC: Adding query filter params (interface=public, service_id=9674842c384c44cc9308459ec4bbf02e, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.342429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.343788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.355948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 299/586] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/endpoints?service_id=9674842c384c44cc9308459ec4bbf02e&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:40.361479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.366138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.456828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f354-87f1-4ae5-a148-5bc046eaef04 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.458678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.492588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb870fc-dc94-47a1-8ad4-2bd1ddcf11a6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.502189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.503309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.503596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.504343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.505258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.505597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.507311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.515707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 288/587] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:40.516951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.537701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.538565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.538875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.539606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.540358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.542213 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.549092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 300/588] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:40.549928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.687158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4da5b4-6461-407d-a397-1022d915065b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.696657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.743139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.743747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.744023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.744292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.756368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:40.761840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:40.762730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:40.763549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:40.768279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 289/589] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:40.769152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.777430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb779-cc41-4221-8fd2-a25b7b981ca7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.799101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.823023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.823642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.823924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.824254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.824891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.825254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.827723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.834471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 301/590] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:40.841478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.876274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ce284-3ca2-44e5-9493-bd488e960e7f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.914310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.915021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.915297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.915570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.916232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.916540 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.918130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.927211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 290/591] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:40.932903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.968217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0075cae-fa88-45f4-b59b-9df6def00fae None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.031325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.043197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.046943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6e8d-024e-4264-afb6-9dc0881b9e3d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.063208 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.063821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.064193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.064351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.065100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] RBAC: Adding query filter params (interface=public, service_id=26570580aaef4aee9d116dcecf87b957, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:41.065586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.067254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.080619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 302/592] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/endpoints?service_id=26570580aaef4aee9d116dcecf87b957&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:41.090556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.093615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.094460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.095082 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.095581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.107673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.109514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:41.126325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:41.127296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:41.128233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:41.128233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:41.128233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:41.130649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 291/593] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:41.140656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.255364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9207-704e-45ac-a1f2-ead76ee7a016 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.283633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433bae9-5db8-4871-9576-3732cba3efdb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.329977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.330580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.330859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.331135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.331775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:41.332077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.335653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.345985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.346589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.346864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.347133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.347730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.349117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.352628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.356814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 303/594] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:41.358920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 292/595] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:41.368605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.458769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.514606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fdb39-1f0b-4b25-a541-420e53d1a3ff None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.558337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.558916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.559195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.559468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.570744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.572273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5926b2db-ad4e-4878-bb38-aefd0872add7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:41.587864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:41.588850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:41.590594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 304/596] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:41.598913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.697699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62373-c1fe-463e-b7a3-c83ea99a4ccd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.698370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62373-c1fe-463e-b7a3-c83ea99a4ccd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.698882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62373-c1fe-463e-b7a3-c83ea99a4ccd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.700842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 305/597] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:41.709471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c987-421c-4817-9457-528129654ef6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.710176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c987-421c-4817-9457-528129654ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.710653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916c987-421c-4817-9457-528129654ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.739639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0916c987-421c-4817-9457-528129654ef6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:41.741169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0916c987-421c-4817-9457-528129654ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:41.748537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759d11-2538-44a8-80fd-8968b8cdec42 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.807201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.807809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.808096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.808475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.809080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:41.809383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.810816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.842907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 293/598] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:41.848273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.900766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 306/599] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:41.914373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.980719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a50ad-5a4a-433c-ad18-de59179bf71a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.027227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.027836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.028111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.028378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.118879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:42.120445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:42.189147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:42.241003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 294/600] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:42.246595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916c987-421c-4817-9457-528129654ef6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.313047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.325918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:42.408256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916c987-421c-4817-9457-528129654ef6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.479537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d30b-983c-4d4a-ab8f-e36124608fc3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.515306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.516261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.516476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.516745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.527974 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.528609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.528887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.529159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.538327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:42.539785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:42.554978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:42.560458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:42.561435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:42.562292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:42.562905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:42.563733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:42.564575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:42.564575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:42.564575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:42.564575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 307/601] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:42.573927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 295/602] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:42.574795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.576972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.614351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:42.734252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:42.736233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47650e-5eb8-4fc5-aee4-36d36c122f93 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.737405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dccc8-4fb1-43ee-9a56-3a256abba874 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.786500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.787034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.787165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.787366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.787627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.787729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.788071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.788256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:42.788520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.788620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:42.789346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:42.789922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:42.790042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbb197-6546-4b6b-9c3f-6d8d44e083e6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:42.791672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b82cad-5632-45fb-8bbf-7abead7c01d5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:42.802815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 308/603] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:42.804145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc8ced-3aa7-4bee-90ad-ef662d950cc4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.804578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc8ced-3aa7-4bee-90ad-ef662d950cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.804952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc8ced-3aa7-4bee-90ad-ef662d950cc4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.806535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 309/604] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:42.808921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 296/605] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:42.811449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc8ced-3aa7-4bee-90ad-ef662d950cc4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.812003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.812287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.812675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.832703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:42.834067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:42.908940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 297/606] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:42.909810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.929516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:42.965926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc8ced-3aa7-4bee-90ad-ef662d950cc4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.029331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.029917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.030291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.030571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.047521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.049051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:43.066341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:43.068412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:43.070534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 310/607] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:43.078663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.100965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9edd-35b7-4211-a373-70b8ed720dba None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.127482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.172136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.173241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.173518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.173805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.190628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.192119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ae977895-a537-4bfd-be22-dedd13623107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:43.220296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:43.222596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:43.225398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:43.225398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:43.225398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:43.229802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 298/608] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:43.229802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3600-c22d-46d1-9ac6-02e2bc3beab9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.229802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3600-c22d-46d1-9ac6-02e2bc3beab9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.229802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3600-c22d-46d1-9ac6-02e2bc3beab9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.231631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 299/609] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:43.232368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3600-c22d-46d1-9ac6-02e2bc3beab9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.260694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd11b4-d07d-492b-a762-aea81666f7ee None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.296060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.300430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.301053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.301319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.301621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.302318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:43.302619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.304093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5eb2-1502-4d35-a7a9-c6050ba45d5d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.321574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 311/610] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:43.321574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.321574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.321574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.336569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:43.337791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:43.348617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3600-c22d-46d1-9ac6-02e2bc3beab9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.382550 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.383153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.383425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.383697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.384335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:43.384634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.386013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.400283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 300/611] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:43.401205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.412431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 312/612] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:43.413601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.435656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.512002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df948a-da3d-4bc6-b852-21cd5db7ad3c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.533782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.538807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca852fec-6829-4acc-954b-97867bc4fe9e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.548446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.548875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.549217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.549575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.550226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.551673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:43.560901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:43.561884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:43.562739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 301/613] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:43.568513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.583214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.584068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.584550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.585257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.586681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=c39f6ddafe58479a8dcf5161294a8b19) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:43.587177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.589181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.596051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 313/614] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/role_assignments?user.id=c39f6ddafe58479a8dcf5161294a8b19&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:43.597000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.686661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.718621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c914a5-f335-434b-aec2-3a2ed50db99a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.724401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e93d4-c6e6-47a8-9a77-9c5a67f3bfe4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.768025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.768672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.768952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.769229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.773927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.774794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.775219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.775635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.776416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:43.777172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.777933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.778914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.779374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.785335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 314/615] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:43.786412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:43.792101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:43.793475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:43.794571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 302/616] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:43.799045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.866224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.912143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebbfc7-0d0d-48d2-b38c-92df19772e33 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.924926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572e55-3475-4486-ae6d-4fc1a430b97c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:43.950255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.950889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.951164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.951633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.952011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.953378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.962220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:43.962822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.963099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.963367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.963994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:43.964298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:43.964588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:43.965507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:25:43.966629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:43.967357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aaa9e-4093-498b-8f6f-f623fbbec4aa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:43.967428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 315/617] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:43.967428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:43.971437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:43.977799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 303/618] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:43.979154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c14e-e9b6-43e8-b581-4321b6e983dc None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:43.979441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c14e-e9b6-43e8-b581-4321b6e983dc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:43.979713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c14e-e9b6-43e8-b581-4321b6e983dc None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:43.981105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 304/619] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:43.985607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c14e-e9b6-43e8-b581-4321b6e983dc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.093448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a595f-eb9e-4156-ada7-b5254d48926a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.117266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c14e-e9b6-43e8-b581-4321b6e983dc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.128361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.132633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.133364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.139568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.139568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.139568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:44.139568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:44.139568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e6a1-ea63-4c49-9432-daa6bede847f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:44.161575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 316/620] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:44.163748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.164030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.164296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.167009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.168057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.168602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.169103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.170043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:44.170573 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:44.173584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:44.181199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 305/621] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Nov 2 07:25:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:44.182531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.185919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:44.187221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:44.266987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.283691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 317/622] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:44.284630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.340501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df082-d56c-4e6c-a6a1-237da93383e0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.411370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.411892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.412168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.412434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.467760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337557e6-26d0-4510-ac80-836eb6e78e59 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.468586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.497823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:44.499377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:44.536217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.536830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.537108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.537380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.538036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:44.538337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:44.540758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:44.552064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 318/623] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:44.563423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.641513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 306/624] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:44.649560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.676397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.725172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.729519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c6958-3989-4587-8395-ff0582e187c6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.761610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add04e9-5c6d-4383-848e-bf21da1d241c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.777091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.777875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.778187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.778568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.779240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:44.780792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:44.798430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.799193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.799565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.799931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.811435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:44.813007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:44.827872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:44.828994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:44.830104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:44.830104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:44.830104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:44.835825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 307/625] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:44.835825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.922226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 319/626] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:25:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:25:44.926522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.973294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69926-ac2f-40c8-9a0a-e0621c19d402 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.024421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.056814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.057758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.059305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.059649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.061003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.062480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:45.077962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:45.079179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:25:45.080186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:45.082242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 308/627] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:45.088353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.146283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1351-49f7-478b-aa7f-ed32879b863a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.161996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.188582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.189781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.190343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.190923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.191824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.192543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.194090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.212770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 320/628] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:45.214331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.240861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009d240-7731-4ff7-a380-7db2c5d49b11 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.288210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.288488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.288863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.289227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.290338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.290887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.293627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.300223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 309/629] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:45.305506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.341387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806337-85bb-4f81-9590-f0ee27b2f865 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.379635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.384007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.392924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.392924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.392924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.393668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.395897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:45.407838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:45.408712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:45.409619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:45.416897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 321/630] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:45.418370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.440395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea8573-bb1e-4b7f-aaf8-0394eefa7bce None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.476016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.488367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.490098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.490098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.490098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.490098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] RBAC: Adding query filter params (type=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.490401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.491751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.501936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 310/631] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:45.508733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.598015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf019b9-071f-4cc3-bdb7-366a7c55b2c7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.637880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.638620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.638896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.639462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.640152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.640450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.642561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.657245 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 322/632] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:45.665174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.729621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8f0ae-1370-4a4b-8e4e-b82f14ec5c49 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.747523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.776963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.787294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e737-3202-4421-926a-183bab045248 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.802275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb19e8e-da72-42d1-9f2b-4a60c3c331a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.802965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb19e8e-da72-42d1-9f2b-4a60c3c331a2 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.803252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb19e8e-da72-42d1-9f2b-4a60c3c331a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.803525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb19e8e-da72-42d1-9f2b-4a60c3c331a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.804206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb19e8e-da72-42d1-9f2b-4a60c3c331a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.805605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb19e8e-da72-42d1-9f2b-4a60c3c331a2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.826275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.829227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.829506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.829805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.830526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=659ffab6d37f4f1aaa7cc68bcfdcc041) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.830828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.832807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea040c-9a4b-4ecd-baa5-f8878a18fda9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.840263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 323/633] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/role_assignments?user.id=659ffab6d37f4f1aaa7cc68bcfdcc041&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:45.919420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 311/634] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:25:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:46.062132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dd99b-8c48-43e2-b99e-4398efa8b67e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.062563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dd99b-8c48-43e2-b99e-4398efa8b67e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.062945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dd99b-8c48-43e2-b99e-4398efa8b67e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.064737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 324/635] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:46.071319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491293cc-241c-410b-8997-51b7bd20f38d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.071618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491293cc-241c-410b-8997-51b7bd20f38d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.071877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491293cc-241c-410b-8997-51b7bd20f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.093528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-491293cc-241c-410b-8997-51b7bd20f38d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:46.094793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-491293cc-241c-410b-8997-51b7bd20f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:46.182499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 312/636] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:46.359127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67867c89-f39a-4b76-9cf4-6c13c19c6d9a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.359457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67867c89-f39a-4b76-9cf4-6c13c19c6d9a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.359689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67867c89-f39a-4b76-9cf4-6c13c19c6d9a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.361258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 325/637] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:46.367517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.367805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.368079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.389693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:46.391117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:46.460347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 313/638] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:46.483211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67867c89-f39a-4b76-9cf4-6c13c19c6d9a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.585576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67867c89-f39a-4b76-9cf4-6c13c19c6d9a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.620954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.621574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.621797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.622058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.622638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.624061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:46.632994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:46.633960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:46.635170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 326/639] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:46.640402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.667582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:46.745810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbddc4-1447-451a-bf01-ba9477ba7c7e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.759851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.786492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.787489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.788312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:46.789070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.789497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.790463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:46.790910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.792440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.801583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 314/640] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:46.803769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.888918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51388da8-48af-4964-9f74-81884606fd27 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.907025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:46.920214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd289c6-47de-48a9-8ec7-d28fe7539d32 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.941712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57329-cb1d-4444-8076-abb247a60e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.942321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57329-cb1d-4444-8076-abb247a60e9c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.942600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57329-cb1d-4444-8076-abb247a60e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.942873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57329-cb1d-4444-8076-abb247a60e9c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.943546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d57329-cb1d-4444-8076-abb247a60e9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.944906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d57329-cb1d-4444-8076-abb247a60e9c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.965028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.965826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.966171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.966511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.967202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:46.967579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.969015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8619c-90b7-4ab4-9db1-f97fdeabe76e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.974383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 315/641] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:47.021754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 327/642] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:25:46 2022] POST /identity/v3/services => generated 269 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:25:47.586042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa527ac-fbb9-4548-a85f-9eaf4440505f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:47.586396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa527ac-fbb9-4548-a85f-9eaf4440505f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:47.586598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa527ac-fbb9-4548-a85f-9eaf4440505f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:47.588160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 316/643] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:47.593434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:47.593754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:47.594025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:47.611802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:47.612963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:47.697210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 328/644] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:47.962590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa527ac-fbb9-4548-a85f-9eaf4440505f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:48.070697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa527ac-fbb9-4548-a85f-9eaf4440505f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:48.111628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:48.112569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.113673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.114117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.114853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:48.116365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b50ecc6f-11a7-40b2-8317-f4a5a09dc42c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:48.125947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:48.127102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:48.128141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:48.130402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 317/645] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:48.136094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:48.145886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:48.199983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b237ee-cd8d-44ed-99ac-e69ab7f072d0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.200305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b237ee-cd8d-44ed-99ac-e69ab7f072d0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.200561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b237ee-cd8d-44ed-99ac-e69ab7f072d0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.202742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 318/646] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:48.211324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.211785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.212152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.232391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:48.233741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:48.245521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:48.248012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17364a2-55de-4f4c-a745-1d750a4d2303 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:48.282961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:48.283835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.284260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.284688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.286852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:48.287307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:48.288817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:48.294269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 329/647] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:48.305589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:48.313678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 319/648] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:48 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:48.374179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:48.404921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abf44-b8bf-4b6e-af10-d7947a9b188c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:48.437630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:48.438467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.438905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.439325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.440085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:48.440559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:48.442204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:48.446987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 330/649] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:48.617786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:48.726167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889a51-4f7a-4fd5-a7ed-e7f9e9630bb6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:48.762794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:48.763431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.763713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.763988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.775814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:48.780955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:48.781971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:48.782833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 320/650] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:25:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:48.790248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:48.894891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b6932-a4de-4da9-98b1-5eb9af1a4844 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:48.933987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:48.934597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.934879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.935151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.935821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:48.936124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:48.937495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:48.939000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:48.947715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 331/651] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Nov 2 07:25:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:48.953354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:48.963206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.060515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c35b-6c92-43cd-99ea-3d8ca6d4a0ac None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.099188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.099847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.100131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.100408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.112499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.114573 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1742db90-55ab-4656-918c-3645f09c257c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:49.131356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:49.132375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:49.133237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:49.133237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:49.133237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:49.133237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 321/652] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:49.139607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.211744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d544e8-933b-46dc-a866-01d8f4a8b0f0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.212032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d544e8-933b-46dc-a866-01d8f4a8b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.212218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d544e8-933b-46dc-a866-01d8f4a8b0f0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.214972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 322/653] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:49.219060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f720adb-117f-4f13-a60a-e63090ffe267 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.219344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f720adb-117f-4f13-a60a-e63090ffe267 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.219619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f720adb-117f-4f13-a60a-e63090ffe267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.239302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8f720adb-117f-4f13-a60a-e63090ffe267 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:49.240600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8f720adb-117f-4f13-a60a-e63090ffe267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:49.259003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35214e82-0eb0-4584-a6f2-36c4553e3ec8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.298246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.299769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.300370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.301200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.301477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.302140 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:49.302446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.303804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.312588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 323/654] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:49.319908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9ec2b-8717-4779-aaf8-5ad538589128 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.319908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9ec2b-8717-4779-aaf8-5ad538589128 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.319908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9ec2b-8717-4779-aaf8-5ad538589128 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.319908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 324/655] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:49.320271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 332/656] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:49.321796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.322229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.322632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.323723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.345870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:49.348565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:49.383462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.430348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126190b3-3577-4f1e-9625-d32b41117da8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.457001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 325/657] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:49.470812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.471369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.471641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.471905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.479804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.481232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:49.492810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:49.493742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:49.494683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 333/658] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:49.499740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.600114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.600558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60b051-db7b-4d6c-a062-a79dd4cc0b3b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.620560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.645935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.647340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.647964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.648246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.649424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:49.649816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.651808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.678539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 326/659] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:49.684272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.721590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cee8f-0bdb-44a4-bfeb-c862dbabbc5b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.740737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.770158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.771196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.771910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.772601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.773406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.775093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.809435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e60c3a-aa89-4060-88db-14084ee038ed None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.842543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.843160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.843436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.843703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.853902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.855367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.865687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 334/660] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:25:49 2022] POST /identity/v3/services => generated 241 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:25:49.865687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:49.879789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:49.881121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:49.882310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:49.882310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:49.882310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:49.884035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 327/661] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:49.889959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.922441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.000676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134e9d-af5a-473c-871a-0beac74dc1d4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.009384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717398-bd92-407e-89ee-18064a1aa53a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.038350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.038986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.039318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.039588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.040173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.041561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.049097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.049799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.050084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.050398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.051045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:50.051226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:50.052122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:50.053013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:50.054317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.054405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 335/662] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:50.057959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.058223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.071723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 328/663] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.077463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.098002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.182172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a333e14-dace-452a-9664-a60f3bc5cccb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.182920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.196260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b183a9a-650a-4cb7-b9a1-814191f869f3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.237594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.237594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.237594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.237594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.238583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.238583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.238583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.238801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.238801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.238801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.238801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.239596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 336/664] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.244969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.246432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.250558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:50.260531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:50.261404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:50.262568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 329/665] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:50.267560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.377229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabecc2f-2aad-4511-b73a-c3f76a5623e5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.382093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.386054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6084b-1dab-4e89-b8fe-29c15ffca4e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.414784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.415390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.415668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.415938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.416673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.416981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.418430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.431419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 330/666] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:50.434317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.435160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.435640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.436117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.436945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.437225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.437801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.439342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.448943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.456256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 337/667] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.457332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.555455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50d855-7372-46f4-a25a-badd7bf8491d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.573593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bdb0f-2775-4be2-af4b-bb32c62c8541 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.593141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384da25e-7771-42c3-a83d-0d7a8b437fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.594201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384da25e-7771-42c3-a83d-0d7a8b437fca None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.594801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384da25e-7771-42c3-a83d-0d7a8b437fca None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.595286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384da25e-7771-42c3-a83d-0d7a8b437fca None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/659ffab6d37f4f1aaa7cc68bcfdcc041/roles/0e5b6554ff3a42fd813b636b5240d648` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.598051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384da25e-7771-42c3-a83d-0d7a8b437fca None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=659ffab6d37f4f1aaa7cc68bcfdcc041, role_id=0e5b6554ff3a42fd813b636b5240d648)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.599882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384da25e-7771-42c3-a83d-0d7a8b437fca None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.610452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.616018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.616018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.616018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.616018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] RBAC: Adding query filter params (interface=public, service_id=8cfc30d3105046ed9879cf878521e902, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.616018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.616018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.625584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 338/668] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/endpoints?service_id=8cfc30d3105046ed9879cf878521e902&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.627288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.657721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.668551 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 331/669] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:50 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/659ffab6d37f4f1aaa7cc68bcfdcc041/roles/0e5b6554ff3a42fd813b636b5240d648 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:50.726619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abcde9-ad57-4acd-b2cd-68ac60fddb33 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.726970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abcde9-ad57-4acd-b2cd-68ac60fddb33 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.727173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abcde9-ad57-4acd-b2cd-68ac60fddb33 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.728786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 332/670] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:50.734708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd697-ddb9-40c7-b9e7-01df784f39be None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.735049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd697-ddb9-40c7-b9e7-01df784f39be None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.735287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd697-ddb9-40c7-b9e7-01df784f39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.758627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5a8bd697-ddb9-40c7-b9e7-01df784f39be None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:50.759283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96de8b-10fe-49ff-b265-a80c9c926600 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.761157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5a8bd697-ddb9-40c7-b9e7-01df784f39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:50.799516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.801107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.801724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.802201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.803044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.804801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.811914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 339/671] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/services => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:25:50.851068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.858643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 333/672] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:50 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:51.139715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:51.245986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:51.258563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c54f43-bfb9-4d45-9d2a-c1365ad4bf43 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.295198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1dbea-aa85-48e4-9b9a-54a8052ea1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.296144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dbea-aa85-48e4-9b9a-54a8052ea1ba None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.296650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dbea-aa85-48e4-9b9a-54a8052ea1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.297132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1dbea-aa85-48e4-9b9a-54a8052ea1ba None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.298048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1dbea-aa85-48e4-9b9a-54a8052ea1ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.299642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1dbea-aa85-48e4-9b9a-54a8052ea1ba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.368655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 340/673] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:25:51 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:52.174424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ff77c-a55e-4291-8d69-4eeb88f83d5e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:52.174938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ff77c-a55e-4291-8d69-4eeb88f83d5e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:52.175052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ff77c-a55e-4291-8d69-4eeb88f83d5e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.177096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 334/674] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:52.182512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:52.182897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:52.183061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.201337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:52.202538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:52.276367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 341/675] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:52.540689 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ff77c-a55e-4291-8d69-4eeb88f83d5e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:52.649067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ff77c-a55e-4291-8d69-4eeb88f83d5e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:52.684664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:52.685294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:52.685590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:52.685868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.686447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:52.687884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:52.696758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:52.697746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:52.698569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 335/676] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:52.704012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:52.782286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:52.805793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d4ed-7732-4798-a5d4-48a8a582ef22 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:52.846988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:52.848146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:52.848460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:52.848732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.849362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:52.849697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:52.851053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a491ca-8dd5-4e9a-b3ef-2d214987327c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:52.856193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 342/677] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:52.862835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:52.922807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c8aa-b0f0-4fc8-8469-9ce4a1ef8b99 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:52.923123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c8aa-b0f0-4fc8-8469-9ce4a1ef8b99 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:52.923348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c8aa-b0f0-4fc8-8469-9ce4a1ef8b99 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.924960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 343/678] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:52.930133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:52.930417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:52.930692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:52.934745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:52.949204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:52.950441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:52.980908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc402-7b3b-4b15-a2fe-1fd19d9cf212 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.024678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.025290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.025591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.025866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.026494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:53.026785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.028155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a258f2-7900-4d66-8c55-3376f76695ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.039938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 336/679] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:53.040110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 344/680] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:53.040203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851f90-b086-43df-a123-00106ecb0b64 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.040203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851f90-b086-43df-a123-00106ecb0b64 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.040203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a851f90-b086-43df-a123-00106ecb0b64 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.040203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 337/681] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:53.040524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.043599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.043599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.043599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.062726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:53.064646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:53.123370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.159088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe353f-87e1-4543-908b-82c52126a19e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.161684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 338/682] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:53.196531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.197150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.197402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.197727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.198424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] RBAC: Adding query filter params (interface=public, service_id=c743a2a53dd248cc9691182f2d87b6d6, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:53.198729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.200135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.205667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 345/683] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/endpoints?service_id=c743a2a53dd248cc9691182f2d87b6d6&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:53.214660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.281332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.326042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbfaa3-a23b-4e70-9909-238eb6e32e8d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.343018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.363521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.364376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.364851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.365306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.366222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.367577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.374343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 339/684] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:25:53.453201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94161-1196-4e10-bfd4-759f666ed25e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.480028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.493994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.494682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.494960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.495232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.498495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.508229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:53.513503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:53.514816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:53.515914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 346/685] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:53.521462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.607362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e815b0-dac4-462f-8932-f09365036c7c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.630264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.646363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961be6ca-aa2b-49d0-aa44-115ada55c207 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.647201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.647962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.648352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.648934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.649643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.652103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-03d917f3-b651-4842-9158-7251e19abadf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:53.662905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:53.663846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:53.664704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 340/686] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:53.665459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6050f-abdb-428b-b83d-471454a4cae8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.665459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6050f-abdb-428b-b83d-471454a4cae8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.666158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6050f-abdb-428b-b83d-471454a4cae8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.667179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 341/687] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:53.669518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6050f-abdb-428b-b83d-471454a4cae8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.694585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.695196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.695473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.695742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.696403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:53.696716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.698254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f545714-b4b8-42a6-b3e7-8f094d8cc7cd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.706987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 347/688] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:53.708436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.708719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.708990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.727616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:53.728971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:53.788912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.789336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6050f-abdb-428b-b83d-471454a4cae8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.802585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 348/689] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:53.803243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.837126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.838244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.838522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.838788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.839411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:53.839710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.841063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.851602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 342/690] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:53.852411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.904423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.930932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68bbc9-2e89-4bdd-9715-cfa401ff097d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.967049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.967665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.967937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.968202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.969738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b242e-14db-4b2c-8cec-2ab066580ad3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.982851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.985256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:54.006929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:54.007924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:54.008818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:54.008818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:54.008818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:54.010179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.010496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 349/691] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:54.011249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.011528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.011796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.012420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.012718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.017602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.017734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.025688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 343/692] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:54.027874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.064823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.126233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a1e2-fd2c-4f83-9399-cec6b0e60ee6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.142043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32eb00-ca82-4c19-9600-a76313912065 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.155740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.162409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.163007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.163334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.167441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.167441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.167441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.167441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.177384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.178131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 350/693] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:54.178241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.178334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.178586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.179232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.181070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.182429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.255961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 344/694] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:25:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:25:54.257427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.294604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.298489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef195-a8c2-4100-834c-ead05ea18d1a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.346735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.347947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.348224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.348496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.349084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.350579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:54.360338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:54.361386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:54.362277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:54.366045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 351/695] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:54.367981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.421325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21ff5-bcf8-4850-a267-46ade7d62941 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.473466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.474500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.474915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.475275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.484772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.487001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.487854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74657-2a3c-43f4-998d-79868fb48043 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:54.503175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:54.504115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:54.505012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 345/696] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:54.511638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.530064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.531063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.531754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.532545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.533422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.534024 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.536604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.543040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 352/697] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:54.545934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.548436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.580178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.621929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383410f7-8bf1-463d-bd2d-64f290226545 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.658894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.659688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.660034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.660501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.661507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.661801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.663362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.664853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0450-5a97-4ab3-a494-961e738e4378 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.687799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 346/698] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:54.688725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.707145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.708409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.708899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.709386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.710258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.710764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.712341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.718641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 353/699] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:54.724442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.790674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.803428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6887ba-8896-4b9e-ab63-db72771fc760 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.833285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:54.847991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.848901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.849364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a6bd-2dab-4a8c-873c-4de833d77528 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:54.849483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.849935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.884572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:54.885331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:54.885848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:54.886076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:54.886851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] RBAC: Adding query filter params (interface=public, service_id=9f8f774851f9476486dcb1a6c061b63d, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:54.887254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.888881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:54.899330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 354/700] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/endpoints?service_id=9f8f774851f9476486dcb1a6c061b63d&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:54.900516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:54.938912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:54.940446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.029087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.038068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa52d-e497-40b7-a626-fe3f7ae8f207 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.045116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 347/701] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:55.051823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.087151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.087758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.088037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.088306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.088907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.090290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.105590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 355/702] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:25:54 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:25:55.176253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d90a3-9e0b-44a0-bfb6-7d514d3e01a9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.216043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.216617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.216897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.217172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.231264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.232968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:55.250770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:55.251781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:55.252761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:55.252761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:55.252761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:55.256182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 348/703] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:55.258702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.283125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.371524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3eae0-4ab1-455d-9598-f2f10333cda2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.405557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.406173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.406453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.406734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.407370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:55.407677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.409198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.425997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 356/704] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:55.428217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.469013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.539735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534beb-6b0b-4654-9453-a2bbecccb58a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.575880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.576878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.577360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.577876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.585912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.587832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e2ea8923-052c-43c1-95a8-8e8918f94695 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:55.599854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:55.600733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:55.601642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:55.603925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 349/705] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:55.609765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.620114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c417598-fc65-4a48-8583-e79e125e35f6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.620404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c417598-fc65-4a48-8583-e79e125e35f6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.620683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c417598-fc65-4a48-8583-e79e125e35f6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.622299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 350/706] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:55.627241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.627530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.627804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.647620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:55.648807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:55.711130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.729989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 351/707] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:55.738129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09a10-598d-49b1-8b38-1f301e41310d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.777174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.777866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.778152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.778433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.779127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:55.779439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.780867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.797423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 357/708] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:55.798859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:55.828582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:55.905163 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e96cfc-5753-478a-8159-488ccb662a88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:55.942516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:55.943440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:55.943910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:55.944376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:55.945272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] RBAC: Adding query filter params (role.id=0e5b6554ff3a42fd813b636b5240d648, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=659ffab6d37f4f1aaa7cc68bcfdcc041) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:55.945784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:55.947388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:55.954206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 352/709] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/role_assignments?user.id=659ffab6d37f4f1aaa7cc68bcfdcc041&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=0e5b6554ff3a42fd813b636b5240d648 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:55.991991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.099096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1c65b-59dd-41d2-b7f1-71e749da6de4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.141535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.142214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.142495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.142770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.143371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.144820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.147998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:56.154989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:56.155981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:56.156799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 358/710] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:56.164230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.268008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:56.278038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1061-e859-4c0b-b9de-5e195c4c68ad None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.315772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.316746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.317248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.317780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.318581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:56.319056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.320596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.329960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 353/711] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:56.334630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.443022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930547-6589-4d89-9c72-dbf602363617 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.478264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.478870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.479150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.479427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.480057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:56.480370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.481737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569df2-8e21-4df7-9498-de2fbc52ba27 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.487035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 359/712] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:56.492723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.525013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d625-375f-4584-89d4-a9181b28f2b8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.525599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d625-375f-4584-89d4-a9181b28f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.526077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d625-375f-4584-89d4-a9181b28f2b8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.527587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 360/713] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:56.533378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.533692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.533968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.557303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:56.558692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:56.613710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0adfe5-3ca2-4837-8535-534d24869aca None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.636150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:56.645694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 361/714] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:56.659041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.660238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.660578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.660857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.661536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.663063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.746935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 354/715] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:25:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:56.917782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:57.021697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974f41-9264-4a40-980c-492cd4f730e5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:57.061032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:57.061683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:57.061956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:57.062227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:57.062796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:57.064153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:57.073560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:57.074510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:57.075358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 362/716] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:57.080781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:57.098838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:57.195255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222b2a-d463-489c-ba22-f815417265ff None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:57.231889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:57.232497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:57.232824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:57.233093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:57.233741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:57.234040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:57.235381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426f3c-24c5-425f-98d2-cf7162ca2492 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:57.241277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 355/717] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:57.246929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:57.303901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:57.356926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130d35c-3775-4b24-ab1d-56b0f5f2effa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:57.397186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:57.398191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:57.398708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:57.399162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:57.400006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:57.400494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:57.402108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4b6ac-bb45-49ed-96ae-f5a2ad786c0d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:57.407954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 363/718] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:25:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:57.497746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded1d6-38ad-4976-b516-8ab19ed23ca0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:57.498246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded1d6-38ad-4976-b516-8ab19ed23ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:57.498246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded1d6-38ad-4976-b516-8ab19ed23ca0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:57.500003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 356/719] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:57.507895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:57.508399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:57.508474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:57.527963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:57.529170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:57.603745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 364/720] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:57.869606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded1d6-38ad-4976-b516-8ab19ed23ca0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:57.950767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:57.975285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded1d6-38ad-4976-b516-8ab19ed23ca0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:58.014390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:58.015655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.016146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.016624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.017402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:58.019523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:58.028727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:58.029704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:25:58.030557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:25:58.033182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 357/721] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:58.039327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:58.087911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:58.139451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327a89b-a377-4c3a-a1d5-390d0f5be157 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:58.179333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:58.179934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.180205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.180471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.181101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:58.181399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:58.182779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acd39-47bd-4500-9ee0-552a65d645b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:58.188001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 365/722] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:58.193572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:58.274723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee003fc-723c-43c5-bdd1-5369c7c01ad8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.275042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee003fc-723c-43c5-bdd1-5369c7c01ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.275269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee003fc-723c-43c5-bdd1-5369c7c01ad8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.277221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 366/723] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:58.282549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.282823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.283093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.303574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ce998-67c9-476a-b532-9c472ca78cc5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:58.304524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:58.306830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:58.339724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:58.340329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.340607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.340879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.341633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:58.341941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:58.343427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:58.349920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 358/724] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Nov 2 07:25:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:58.359327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:58.364272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:58.394200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 367/725] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:58.464527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f06a3b-66f0-4969-b159-12b2a428c810 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:58.498126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:58.498764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.498994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.499261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.499917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:58.501268 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:58.625892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 359/726] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:25:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:58.666805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:58.716138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:58.778244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4177b29-72ae-418c-816c-4fd8394943fe None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:58.827743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:58.828741 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.829041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.829340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] PATH_INFO: `/v3/services/image` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.830047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:58.831552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:58.841525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:58.842504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:58.843330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 368/727] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Nov 2 07:25:58 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:58.850196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:58.913121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:58.956797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213fc0-9ca8-4157-8c66-9890fe82bee3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:58.995692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:58.996572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.996998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.997471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.998292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] RBAC: Adding query filter params (name=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:58.998772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.000285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa9409-dad2-4fbb-a86a-5df1b31f6d3b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.006077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 360/728] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:59.011779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.088861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fb638-fb74-4d8f-b523-846931b58023 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.089147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fb638-fb74-4d8f-b523-846931b58023 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.089433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fb638-fb74-4d8f-b523-846931b58023 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.091055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 361/729] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:59.096008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.096312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.096563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.117376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3288b6-5378-47c3-8e13-dfd61c00f9df None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.117837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:59.119331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:59.119732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.153783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.154732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.155175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.155596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.156521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.156971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.158744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.163674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 369/730] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.209844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 362/731] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:25:59.483130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.591599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e546-dc7d-4f23-bc71-f74d362784d8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.627188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.627852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.628660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.628932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.629511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.630893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-70be1fb5-845c-409d-a96f-4e3e01a99247 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:59.640194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:59.641198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:25:59.642063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 370/732] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:59.649842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.691442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91919c-d549-43db-bf02-79db007c6733 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.691982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91919c-d549-43db-bf02-79db007c6733 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.691982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91919c-d549-43db-bf02-79db007c6733 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.694639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 371/733] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:59.698680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.698969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.699246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.713452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.722371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:59.723563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:59.751931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.776909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff597158-1d18-4f4f-9466-b86c41d0f94a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.805399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 372/734] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:59.819922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.820776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.821277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.821784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.822654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.823200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.824740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.830301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 363/735] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.836318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.947956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caca4f-9d11-4707-9917-165467c24e8a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.983322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.983930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.984204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.984473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.985093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.985392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.986768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.992677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 373/736] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.998418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.078513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.105598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ac03-9dc4-43da-bf9b-c5d5c6e3718a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.110332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:00.124557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:00.142999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.144192 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.144824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.145398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.146338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] RBAC: Adding query filter params (interface=admin, service_id=c743a2a53dd248cc9691182f2d87b6d6, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:00.147007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.148464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.156368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 364/737] 10.222.0.26 () {56 vars in 1249 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/endpoints?service_id=c743a2a53dd248cc9691182f2d87b6d6&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:00.162423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:00.201589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979697-4179-4542-bd50-be0f03891e25 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.245983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7678b-88ed-48c4-a510-d77c0556a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.247118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7678b-88ed-48c4-a510-d77c0556a3b3 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.247595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7678b-88ed-48c4-a510-d77c0556a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.248148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7678b-88ed-48c4-a510-d77c0556a3b3 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.249095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7678b-88ed-48c4-a510-d77c0556a3b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.250675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7678b-88ed-48c4-a510-d77c0556a3b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.280584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660f83-c776-4210-a308-e399c82f9f99 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:00.305654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 374/738] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:26:00 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:26:00.335344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591bef3-7440-46f9-aefc-598cfe4b031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:00.336026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591bef3-7440-46f9-aefc-598cfe4b031a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.336352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591bef3-7440-46f9-aefc-598cfe4b031a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.336630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591bef3-7440-46f9-aefc-598cfe4b031a None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.337247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591bef3-7440-46f9-aefc-598cfe4b031a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:00.338832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591bef3-7440-46f9-aefc-598cfe4b031a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:00.346856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 365/739] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:26:00 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:26:00.991788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a09df-8a73-4db7-97f7-c68ecb579b2c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.992330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a09df-8a73-4db7-97f7-c68ecb579b2c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.992330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a09df-8a73-4db7-97f7-c68ecb579b2c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:00.993900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 375/740] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:00.999276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234b95-f1c2-4843-b8c5-90b073002107 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:00.999681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234b95-f1c2-4843-b8c5-90b073002107 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:00.999854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234b95-f1c2-4843-b8c5-90b073002107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.018954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-75234b95-f1c2-4843-b8c5-90b073002107 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:01.020124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-75234b95-f1c2-4843-b8c5-90b073002107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:01.056041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:01.093873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 366/741] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:01.357863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a09df-8a73-4db7-97f7-c68ecb579b2c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:01.442691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958131-f66b-4ef5-b630-02176032cbf6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.443036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958131-f66b-4ef5-b630-02176032cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.443244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958131-f66b-4ef5-b630-02176032cbf6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.444829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 367/742] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:26:01.448629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:01.449924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.449924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.450201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.465568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a09df-8a73-4db7-97f7-c68ecb579b2c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:01.468284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:01.469698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:01.509252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:01.509979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.510323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.510687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.511398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:01.512942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:01.516072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING keystone.server.flask.common [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 07:26:01.541870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 368/743] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:26:01.561944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:26:01.561944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:26:01.561944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [parameters: {'id': 'c6e317937e4d4c0e97e57fb9dec60da4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:26:01.561944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6e317937e4d4c0e97e57fb9dec60da4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6e317937e4d4c0e97e57fb9dec60da4. Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:26:01.570552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:26:01.571326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Nov 02 07:26:01.572655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:26:01.573966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:26:01.574839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:26:01.575598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'id': 'c6e317937e4d4c0e97e57fb9dec60da4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:01.576466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:01.578758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6e317937e4d4c0e97e57fb9dec60da4. Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:01.580889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 376/744] 10.222.0.26 () {60 vars in 1140 bytes} [Wed Nov 2 07:26:01 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:01.582217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:01.683600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3250-3ac9-4541-bc69-91c1420d84df None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:01.685041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:01.719448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:01.720076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.720352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.720618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.727291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:01.728829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:26:01.741557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:01.742404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:01.743653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 369/745] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:01.748886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:01.817772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:01.863299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a43b4-e02b-471f-ac47-e6eae84fa819 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:01.899065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:01.899711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.899988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.900253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.900904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:01.901201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:01.902831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711f070-8eda-45ed-86f7-9c1d74b52ea0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:01.917668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:01.930175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 377/746] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:26:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:01.945133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e088a0-d49b-44ad-9d47-bebee705ad50 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:01.985211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478c3b3-7005-48ab-adc2-b8d148f13ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:01.986142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c3b3-7005-48ab-adc2-b8d148f13ac5 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.986636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c3b3-7005-48ab-adc2-b8d148f13ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.987642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c3b3-7005-48ab-adc2-b8d148f13ac5 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.988526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478c3b3-7005-48ab-adc2-b8d148f13ac5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:01.990223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478c3b3-7005-48ab-adc2-b8d148f13ac5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:02.061951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 370/747] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:26:01 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:02.602283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d5c1-9de0-4148-bfb7-7c9295a39f9a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.602799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d5c1-9de0-4148-bfb7-7c9295a39f9a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.602875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d5c1-9de0-4148-bfb7-7c9295a39f9a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.603329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f47a-9ab1-4074-b4ad-ccaeba00f5f3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.603618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f47a-9ab1-4074-b4ad-ccaeba00f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.603900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f47a-9ab1-4074-b4ad-ccaeba00f5f3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.604424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 378/748] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:02.605456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 371/749] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:02.610524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.610809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.611084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.614167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.614556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.614932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.629994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:02.631189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:02.637103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:02.638644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:02.650757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:02.729646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 372/750] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:02 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:02.745653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 379/751] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:02 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:03.003881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.024681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.117300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147727-27b3-4f11-97d7-4c48e5a4a33b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.141197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d393-6e07-4767-9407-906cb6e9baec None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.161055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.161916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.162497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.162934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.163657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.165179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.172804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:03.175017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:03.176229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:26:03.177112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:03.184406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 373/752] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:03.185059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.188750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.189386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.189713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.189991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.191701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.192617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:03.202383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:03.203470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:26:03.204387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:03.211906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 380/753] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:03.212904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.215125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.333676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d7838-dfbc-44cc-a11d-7b62eef8cb90 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.334637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefbc6e-c0cb-4c3f-b1ec-e499e250083c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.369344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.369992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.370269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.370538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.371164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:03.371452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.372812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.382751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 381/754] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:03.383778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.387219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.387729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.388010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.388282 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.389992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:03.389992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.390893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.401179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 374/755] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:03.402445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.453827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.480739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.503584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fc3cf-7c15-4444-8bcd-7aa37f020374 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.509419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830de604-4843-4b3e-a374-2b1a5d88950c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.539748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.540322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.540653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.540932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.541570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:03.541920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.543291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.551699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.552560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.553019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 375/756] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:03.553277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.553786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.554310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.554924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:03.555494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.557368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.570002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 382/757] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:03.571513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.683092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23c280-a5fc-4826-ae8a-8bb34c6dc50a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.689467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d7ca-37f1-4672-8021-f1bb90f19d4b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.702065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.719318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d54c31-9017-46a4-bb83-2e3c95c592c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.720044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54c31-9017-46a4-bb83-2e3c95c592c6 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.720291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54c31-9017-46a4-bb83-2e3c95c592c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.720569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54c31-9017-46a4-bb83-2e3c95c592c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.721232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54c31-9017-46a4-bb83-2e3c95c592c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.722775 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54c31-9017-46a4-bb83-2e3c95c592c6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.736760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.737739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.738227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.738772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.739698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] RBAC: Adding query filter params (interface=public, service_id=0794ee130c134360aad53270ece902d3, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:03.740207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.742031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.748020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 376/758] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/endpoints?service_id=0794ee130c134360aad53270ece902d3&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:03.754521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:03.758150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:03.798069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 383/759] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:03.867038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac8da3-b1ae-4536-b8b6-3f8575160e52 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:03.917355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979c5f-f856-49dc-af86-54d1dbea0e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:03.918375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979c5f-f856-49dc-af86-54d1dbea0e6c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:03.918856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979c5f-f856-49dc-af86-54d1dbea0e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:03.919351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979c5f-f856-49dc-af86-54d1dbea0e6c None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:03.920158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af979c5f-f856-49dc-af86-54d1dbea0e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:03.921773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af979c5f-f856-49dc-af86-54d1dbea0e6c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:03.935848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 377/760] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:26:03 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:26:04.179054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4192b78-f103-473c-ba7d-1fdaee95b137 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.179333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4192b78-f103-473c-ba7d-1fdaee95b137 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.179849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4192b78-f103-473c-ba7d-1fdaee95b137 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.181687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 384/761] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:04.187180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21bb21-2770-45d4-9926-97375f8ba57f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.187604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21bb21-2770-45d4-9926-97375f8ba57f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.187692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21bb21-2770-45d4-9926-97375f8ba57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.210911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fa21bb21-2770-45d4-9926-97375f8ba57f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:04.212148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fa21bb21-2770-45d4-9926-97375f8ba57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:04.286447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.296005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 378/762] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:04 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:04.329270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7a349-1189-47d1-8394-744468f671c8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.329915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7a349-1189-47d1-8394-744468f671c8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.330397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7a349-1189-47d1-8394-744468f671c8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.332264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 385/763] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:04.337782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.338353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.338826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.357413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:04.358915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:04.428732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 379/764] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:04 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:26:04.579194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7a349-1189-47d1-8394-744468f671c8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.687470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7a349-1189-47d1-8394-744468f671c8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.696291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.728286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.728904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.737333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.737333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.737333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.737333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.778894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:26:04.778894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:26:04.778894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [parameters: {'user_id': 'e8268710e9184699b281cb7f8a1ebb9b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:26:04.778894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:26:04.787231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:26:04.788309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:26:04.789319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:26:04.790204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:26:04.791047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:26:04.791849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e8268710e9184699b281cb7f8a1ebb9b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:04.792681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 07:26:04.793434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:04.794317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 386/765] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Nov 2 07:26:04 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:04.797018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.817300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81bbc2-394e-4174-8ecd-22afc820ff16 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.843553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.850473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:04.855362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.856129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.856466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.857683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.857683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.859052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:04.868068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:04.869302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:26:04.870373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:04.876497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 380/766] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:04.877609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:04.923296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f46b-6928-4bc3-9fb3-449189bf66d0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.964464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:04.965913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:04.966336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:04.967149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:04.976597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:04.978931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:04.993245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff32320-93fe-49d1-b381-065a5efe5237 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:26:04.997616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:04.998519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:26:04.999450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:05.005942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 387/767] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:05.008898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.035437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.036119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.036396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.036675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.037358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.037794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.039280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.049049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 381/768] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:05.049951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.114674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:05.145977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:05.149891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce5e5-b1b0-4213-95f0-66558fefa7b6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.168831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc7757-7fd0-4930-b980-c4f6a7199ab5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.195962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.196622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.196906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.197184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.198194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.198511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.200606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.208915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.210124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.210635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.211117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.212024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] RBAC: Adding query filter params (type=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.212627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.214197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.220347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 382/769] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:05.227317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.254914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 388/770] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:05.348219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746082cc-89b1-4e02-ac66-c6e3d76207ae None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.366760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:05.387453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.388455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.389053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.389804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.390722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] RBAC: Adding query filter params (interface=public, service_id=aae9c7ce8e144ef5a379e28a0797db47, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:05.391226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.392802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587e09-95f7-44dd-82ca-196462ee61b0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.400023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 383/771] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/endpoints?service_id=aae9c7ce8e144ef5a379e28a0797db47&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:05.405753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:05.511944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91616d-5aa6-4f7f-a6b4-3f3d807bd99d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:05.547629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de34c6-8e1a-433c-9973-aea31d76ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:05.548300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de34c6-8e1a-433c-9973-aea31d76ab39 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:05.548583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de34c6-8e1a-433c-9973-aea31d76ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:05.548855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de34c6-8e1a-433c-9973-aea31d76ab39 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:05.550000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de34c6-8e1a-433c-9973-aea31d76ab39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:05.551378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de34c6-8e1a-433c-9973-aea31d76ab39 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:05.558624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 389/772] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:26:05 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:06.059675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829050b6-f68c-49a9-8bcd-24d03f816180 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.059954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829050b6-f68c-49a9-8bcd-24d03f816180 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.060346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829050b6-f68c-49a9-8bcd-24d03f816180 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.061782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 384/773] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:06.067534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476595a2-fde8-47d6-b08d-b5b19ffdd69b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.068080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476595a2-fde8-47d6-b08d-b5b19ffdd69b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.068080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476595a2-fde8-47d6-b08d-b5b19ffdd69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.087499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-476595a2-fde8-47d6-b08d-b5b19ffdd69b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:06.089071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-476595a2-fde8-47d6-b08d-b5b19ffdd69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:06.107567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:06.157938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 390/774] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:06.192699 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505edfb8-c99f-4c7b-ab4b-625c95bf82fa None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.193008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505edfb8-c99f-4c7b-ab4b-625c95bf82fa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.193258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505edfb8-c99f-4c7b-ab4b-625c95bf82fa None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.194772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 385/775] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:06.199853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.200139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.200410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.218788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:06.221757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:06.297590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 391/776] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:06.424181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505edfb8-c99f-4c7b-ab4b-625c95bf82fa None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:06.529726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505edfb8-c99f-4c7b-ab4b-625c95bf82fa None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:06.562449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:06.562600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:06.563118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.563392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.563661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.564751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:06.566720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:06.569585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 386/777] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:06.573697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:06.622911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:06.648067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:06.666989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b509-1347-46c8-9d39-0544d014ff3a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:06.678478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27587bc-bef4-4dda-846b-3ffc7730d104 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:06.703211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:06.703834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.704132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.704394 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.704978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:06.706960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:06.713353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:06.713980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.714259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.717819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.717819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:06.717994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:06.718888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:26:06.719718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:06.720457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:06.720555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 392/778] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:06.723217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:06.823564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd462f40-2cc9-4cfe-950c-e79dd63a0af3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:06.831277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 387/779] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:26:06 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:06.862390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:06.863016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:06.863350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:06.863626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:06.864265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:06.864567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:06.865990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:06.876329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 393/780] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:26:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:06.878143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:06.984766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:06.988556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82884944-c342-411f-8cbf-bed4c39c82a9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:07.027543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:07.028217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:07.028506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:07.028780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:07.029431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:07.029741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:07.031111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4d420-fd16-4d3f-b336-37258d074175 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:07.036346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 388/781] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Nov 2 07:26:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:07.042127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:07.171086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:07.268596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0cb44-5539-4213-8429-7ac7c8d18696 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:07.302174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdbecc-7bf6-445f-98e3-ba9d3a6f1e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:07.302771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdbecc-7bf6-445f-98e3-ba9d3a6f1e89 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:07.303047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdbecc-7bf6-445f-98e3-ba9d3a6f1e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:07.303317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdbecc-7bf6-445f-98e3-ba9d3a6f1e89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:07.303966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdbecc-7bf6-445f-98e3-ba9d3a6f1e89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:07.305314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdbecc-7bf6-445f-98e3-ba9d3a6f1e89 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:07.414521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 394/782] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:26:07.729069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c105-9e9f-4753-82cc-b3c70355008e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:07.729605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c105-9e9f-4753-82cc-b3c70355008e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:07.729714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c105-9e9f-4753-82cc-b3c70355008e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:07.731126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 389/783] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:07.736346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:07.736662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:07.736940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:07.755132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:07.756315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:07.818181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:07.837028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 395/784] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:08.100987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c105-9e9f-4753-82cc-b3c70355008e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.203240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c105-9e9f-4753-82cc-b3c70355008e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.243389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.244265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.244724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.245202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.245996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.247523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:08.256993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:08.257984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:08.261638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 390/785] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Nov 2 07:26:08 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:08.265182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.363382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea37b3-cbdc-40dd-812b-dde35cacd3db None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.400274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.401208 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.401696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.402162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.402951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] RBAC: Adding query filter params (name=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:08.403426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.405016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.414576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 396/786] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:08.416263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.446985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:08.518548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc38c-9192-4f52-98da-568c3d7cce5c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.552057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.552989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.553471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.553996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.554811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] RBAC: Adding query filter params (type=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:08.555328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.556945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d00db-3982-486e-b1af-fe9fd264b1bb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.567033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 391/787] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:08.568789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:08.626172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:08.669744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16444233-ffa8-4824-92ad-534d94c49296 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:08.703678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a7544-8cab-4ee7-a76b-a949c55d6ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:08.704283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a7544-8cab-4ee7-a76b-a949c55d6ea8 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:08.704564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a7544-8cab-4ee7-a76b-a949c55d6ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:08.704872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a7544-8cab-4ee7-a76b-a949c55d6ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:08.705598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a7544-8cab-4ee7-a76b-a949c55d6ea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:08.706963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a7544-8cab-4ee7-a76b-a949c55d6ea8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:08.793582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 397/788] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:26:09.036404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661c355-6a7f-46f4-ba22-7a676567d6c3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:09.036891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661c355-6a7f-46f4-ba22-7a676567d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:09.036891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661c355-6a7f-46f4-ba22-7a676567d6c3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:09.038474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 392/789] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:09.043958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:09.044230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:09.044509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:09.062961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:09.064121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:09.136788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 398/790] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:09.407155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661c355-6a7f-46f4-ba22-7a676567d6c3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:09.499823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:09.509987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661c355-6a7f-46f4-ba22-7a676567d6c3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:09.549392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecc9c4-20aa-4aff-96cd-42415b793e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:09.550052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecc9c4-20aa-4aff-96cd-42415b793e62 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:09.550328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecc9c4-20aa-4aff-96cd-42415b793e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:09.550595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecc9c4-20aa-4aff-96cd-42415b793e62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:09.551717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecc9c4-20aa-4aff-96cd-42415b793e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:09.553136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecc9c4-20aa-4aff-96cd-42415b793e62 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:09.554879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 393/791] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:09.560485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:09.600163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:09.637524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc384-d48f-45a9-9b6b-8b56700bf9b4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:09.637839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc384-d48f-45a9-9b6b-8b56700bf9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:09.638121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc384-d48f-45a9-9b6b-8b56700bf9b4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:09.640377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 394/792] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:26:09.645156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:09.645441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:09.645781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:09.663186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c2376-1e6c-4b51-b02d-1a6a043d4151 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:09.663977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:09.665141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:09.702170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:09.702787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:09.703057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:09.703319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:09.703986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:09.706071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:09.735566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 395/793] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:26:09.790640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 399/794] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:26:09 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:10.004832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.096398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:10.106046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd1da-382d-4269-9b92-55e0ed1c3ac0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:10.140733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:10.141362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.141673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.141950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.151995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:10.156796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:10.157906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:10.159024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 396/795] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:10.163913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.261928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:10.268661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5957-4477-4b2e-83be-e9329aa53474 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:10.304406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:10.305010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.305326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.305626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.306290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:10.306590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:10.307987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:10.316627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 400/796] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:10.322063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.425570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d637a-5b82-4887-a702-567e758f9953 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:10.460445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:10.461121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.461404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.461732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.472625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:10.474094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:10.488386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:10.489302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:10.490752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:10.490752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:10.490752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:10.491172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 397/797] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:10.495333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.598163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cd07b-fc06-4bde-91ea-9651d7541182 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:10.631419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:10.632026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.632302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.632569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.633263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:10.633590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:10.634939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:10.651878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 401/798] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:10.653616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.656675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:10.759012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d70a6-91fc-498f-a04d-0c40b84cf8a4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:10.792199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c130-4458-4296-8455-3a244932146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:10.792825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c130-4458-4296-8455-3a244932146b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.793106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c130-4458-4296-8455-3a244932146b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.793381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c130-4458-4296-8455-3a244932146b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.801174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c130-4458-4296-8455-3a244932146b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:10.802631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c130-4458-4296-8455-3a244932146b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b146c130-4458-4296-8455-3a244932146b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:26:10.813581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:10.814500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:26:10.816036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:10.817906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 398/799] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:10.821238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.839289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:10.925634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe459a-588e-4a19-b76d-99afd795bebf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:10.959647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:10.960249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.960528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.960803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.961524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:10.961870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:10.963285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaaf0d-d05e-442b-a3c7-b2978b4aaab3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:10.984736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 402/800] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:10.986267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c130-4458-4296-8455-3a244932146b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:10.997206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19eb54-3e1e-4b70-b9dd-8148b79fad58 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:10.997492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19eb54-3e1e-4b70-b9dd-8148b79fad58 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:10.997799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19eb54-3e1e-4b70-b9dd-8148b79fad58 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:10.999260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 403/801] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:26:11.004589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.004874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.005147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.023592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:11.024778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:11.051306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:11.091285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c130-4458-4296-8455-3a244932146b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.093190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 404/802] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:26:11.125310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.125977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.126235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.126507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.136907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.138362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:11.152414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:11.153321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:11.159388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:11.159388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:11.159388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:11.159388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 399/803] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:11.159684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.163256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:11.266366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04b39b-74fb-46aa-b482-5f27bb0da147 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.300489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.301086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.301363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.301661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.302305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:11.302588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.303935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.315284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 405/804] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:11.320667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.375130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.425136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acb98b-904b-4bb9-9ce0-b47231806a0b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.440717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:11.443055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:11.463708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.464341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.464622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.464895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.473209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.474687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.485693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5cf7-04d4-4cc2-ac63-3bda15c48c26 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:26:11.487514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:11.488375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:11.489225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:11.493516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 400/805] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:11.494221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.520965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.521971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.522496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.522918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.523722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.525461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.561008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:26:11.561008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:26:11.561008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [parameters: {'id': 'dd0fe5f206964c1693b4e1de939dab74', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:26:11.561008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:26:11.568973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:26:11.570037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:26:11.570933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:26:11.571860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:26:11.572808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:26:11.574247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'id': 'dd0fe5f206964c1693b4e1de939dab74', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:26:11.575629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:11.576569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 406/806] 10.222.0.26 () {60 vars in 1137 bytes} [Wed Nov 2 07:26:11 2022] POST /identity/v3/domains => generated 190 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:11.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.606298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1052aa-ee33-4040-aba8-b096c336a9ff None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.640301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.640904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.641188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.641461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.642183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:11.642483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.644417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.656146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 401/807] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:11.662595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.689095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0af67-84a2-48a4-9ac7-15418e972de9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.701693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:11.716896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:11.726155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.726789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.727070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.727348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.744685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.744685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:11.754534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:11.755477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:11.756349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:11.756349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:11.756349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:11.756349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 407/808] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:11.763145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:11.776807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8a48f-0a99-4170-85fe-4ff96e77948c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.811382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da08be-bfcb-4526-b139-0b549b72032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.812044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da08be-bfcb-4526-b139-0b549b72032d None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.812329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da08be-bfcb-4526-b139-0b549b72032d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.812598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da08be-bfcb-4526-b139-0b549b72032d None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0297ece9087142c1987312d97a6a3867/roles/0e5b6554ff3a42fd813b636b5240d648` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.815317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da08be-bfcb-4526-b139-0b549b72032d None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=0297ece9087142c1987312d97a6a3867, role_id=0e5b6554ff3a42fd813b636b5240d648)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.816745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da08be-bfcb-4526-b139-0b549b72032d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.864677 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 402/809] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:26:11 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/0297ece9087142c1987312d97a6a3867/roles/0e5b6554ff3a42fd813b636b5240d648 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:26:11.866317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f9700-604e-4091-9a41-7528d8df11e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:11.916568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:11.917609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:11.918087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:11.918551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:11.919387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:11.919902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:11.921497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffd320-cfd2-4ea0-b4af-15743a378f8c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:11.935938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 408/810] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:12.005641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011da96-a72b-4ebf-8fcd-c236ded387f2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:12.005842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011da96-a72b-4ebf-8fcd-c236ded387f2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:12.006216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011da96-a72b-4ebf-8fcd-c236ded387f2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:12.007739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 403/811] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:12.013872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:12.014486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:12.014671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:12.034901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:12.036139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:12.074556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:12.112216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 409/812] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:12.381081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011da96-a72b-4ebf-8fcd-c236ded387f2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:12.472131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:12.479104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011da96-a72b-4ebf-8fcd-c236ded387f2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:12.511391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:12.512056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:12.512327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:12.512595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:12.523510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:12.528214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:12.529205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:12.530185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 404/813] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:12.535885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:12.629771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610fa2d-bead-4997-be18-579e1acb1566 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:12.662080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:12.662607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:12.662879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:12.663143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:12.663788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:12.664082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:12.665421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:12.673154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 410/814] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:12.678957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:12.778862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5d20c-b9fa-4648-ac82-b49042a9ea59 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:12.811692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:12.812302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:12.812580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:12.812849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] PATH_INFO: `/v3/users/24ad0604011849a29f0e37f8178471c2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:12.825771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] RBAC: Authorizing `identity:get_user(user_id=24ad0604011849a29f0e37f8178471c2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:12.827183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:12.828736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 405/815] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:12 2022] GET /identity/v3/users/24ad0604011849a29f0e37f8178471c2 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:12.834964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:12.864717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:12.929397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94071561-489c-4a35-bacd-a8942ffb81e8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:12.960617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ede704-015f-4e9b-aea2-2cab5ff9b1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:12.961225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ede704-015f-4e9b-aea2-2cab5ff9b1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:12.961498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ede704-015f-4e9b-aea2-2cab5ff9b1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:12.961801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ede704-015f-4e9b-aea2-2cab5ff9b1a7 None admin] PATH_INFO: `/v3/projects/8e5816b5857f436c9249959b27e9764f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:12.962884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ede704-015f-4e9b-aea2-2cab5ff9b1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5816b5857f436c9249959b27e9764f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:12.964281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ede704-015f-4e9b-aea2-2cab5ff9b1a7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:12.965896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 411/816] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:12 2022] GET /identity/v3/projects/8e5816b5857f436c9249959b27e9764f => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:12.971678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:12.985779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:13.066962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dd3e4-6d06-4b04-8ebd-9e6ca75879fc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:13.099130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3f23-f6c8-478b-9e5d-a4529c905816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:13.099775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3f23-f6c8-478b-9e5d-a4529c905816 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:13.100051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3f23-f6c8-478b-9e5d-a4529c905816 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:13.100315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3f23-f6c8-478b-9e5d-a4529c905816 None admin] PATH_INFO: `/v3/projects/8e5816b5857f436c9249959b27e9764f/users/24ad0604011849a29f0e37f8178471c2/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:13.102184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae3f23-f6c8-478b-9e5d-a4529c905816 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5816b5857f436c9249959b27e9764f, user_id=24ad0604011849a29f0e37f8178471c2, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:13.103599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae3f23-f6c8-478b-9e5d-a4529c905816 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:13.171178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 406/817] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:26:12 2022] PUT /identity/v3/projects/8e5816b5857f436c9249959b27e9764f/users/24ad0604011849a29f0e37f8178471c2/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:14.022292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf416a64-303d-4631-bcb9-ef83b0e2c476 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.023106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf416a64-303d-4631-bcb9-ef83b0e2c476 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.023295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf416a64-303d-4631-bcb9-ef83b0e2c476 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.024691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 412/818] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:14.030613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.031126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.031235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.049359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:14.050558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:14.113463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 407/819] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:14.377330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf416a64-303d-4631-bcb9-ef83b0e2c476 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:14.470837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:14.474480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf416a64-303d-4631-bcb9-ef83b0e2c476 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.506555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.507162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.507436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.507701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.517405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:14.522226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:14.523119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:14.523942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 413/820] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:14.529391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:14.531593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:14.625158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee52a-00f1-4b33-bf66-4e725448fa78 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.658633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.659157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.659432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.659696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.660339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:14.660634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:14.662024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:14.669491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 408/821] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:14.676004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:14.772935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5a1e4-3dd3-450e-91d8-58a97b60eb38 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.806089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.806707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.806982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.807251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.817378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:14.818836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:14.832493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:14.833591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:14.834461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:14.834461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:14.834461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:14.834461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 414/822] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:14.839503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:14.899565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:14.938000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936860b1-a96e-4012-b82e-8998352d54ad None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:14.970249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:14.971331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:14.971607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:14.971875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:14.972503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:14.972801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:14.974183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:14.985606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 409/823] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:14.991741 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.007178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:15.090655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb88e91-8294-4b4f-8cb2-6515a2d11a1a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.122602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.123220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.123498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.123767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.131467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:15.132880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c3d14dd0-7ebd-4fd5-84ec-e2bd5cfdba13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:26:15.144408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:15.145288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:15.146253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 415/824] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Nov 2 07:26:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:15.151187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.254524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba687b-ea93-4d8d-8b1a-7c84d52d8b4d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.276883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:15.287102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.287696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.287970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.288238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.288945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:15.289243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:15.290690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:15.297095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b3c9-fa52-4e59-8070-9a1c7e59248d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.307735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b3c9-fa52-4e59-8070-9a1c7e59248d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.307735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b3c9-fa52-4e59-8070-9a1c7e59248d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.307735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 416/825] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:15.307735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.307735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.307735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.309406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 410/826] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:15.315213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.324188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:15.325445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:15.390956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 417/827] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:26:15.411907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49735546-7b2a-4b95-960f-f3fdb37f6a2e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.444766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.445353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.445658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.445929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.491778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:15.509489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:15.510935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:15.604410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 411/828] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:26:15.610239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.613302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:15.662871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.706033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ef0c-f229-48c8-aa06-22d65cc3d0ce None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.739495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.740113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.740387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.740658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.744035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:15.750711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:15.752144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:15.761246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583f76f-fb41-4664-ab4e-4a466fba2a2b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:26:15.766657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:15.767618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:26:15.768509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:26:15.768509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:26:15.768509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:15.768509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 418/829] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:15.773295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.795944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.796570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.796850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.797118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.807433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:15.812203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:15.813231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:15.814085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 412/830] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:15.819115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.830772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:15.874038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265cd5-1db4-4b1c-8977-9e61f3baad16 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.906251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.906844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.907119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.907387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.908549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:15.908849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:15.910219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:15.917754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82901-15bc-4989-847a-c79177edd544 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:15.921447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 419/831] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:15.927148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.952298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:15.952892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:15.953179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:15.953466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:15.954151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:15.954449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:15.956362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:15.964067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 413/832] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:15.969883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:15.974366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.022476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7172-8258-4290-9ddb-1d984420239f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.036348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.055584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.056213 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.056477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.056746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.063473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.065346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.067159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0f44e-43e2-4f6c-8de2-dc0242c5f012 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:26:16.077085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:16.078044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:16.078897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 420/833] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:26:16.084588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:16.103581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.104194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.104472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.104740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] PATH_INFO: `/v3/users/24ad0604011849a29f0e37f8178471c2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.105875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=24ad0604011849a29f0e37f8178471c2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.107280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.108835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 414/834] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:15 2022] GET /identity/v3/users/24ad0604011849a29f0e37f8178471c2 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:16.114336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:16.179231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c361f8-cf6d-45a6-8b7c-9dbf9d90091a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.182984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.211194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495e963-cf7e-4d87-a05a-a82cffe65ca4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.212000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.212602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.212877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.213152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.213869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:16.214172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.215580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.228053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 421/835] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:16.233989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:16.245878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.246472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.246744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.247012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.266216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.315572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.316956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.331124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cba64-bb10-4978-813b-4de856bf7a7e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.363331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.363930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.364212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.364486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.365202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] RBAC: Adding query filter params (role.id=0e5b6554ff3a42fd813b636b5240d648, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=0297ece9087142c1987312d97a6a3867) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:16.365512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.366978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.372916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 422/836] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/role_assignments?user.id=0297ece9087142c1987312d97a6a3867&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=0e5b6554ff3a42fd813b636b5240d648 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:16.383867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.416592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 415/837] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:26:16.422582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:16.523409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:16.527190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1e26-bcea-4dea-a884-11f0d69253ad None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.560366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a064a-3ce2-4f0c-8e18-9e5f4c13ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.560997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a064a-3ce2-4f0c-8e18-9e5f4c13ad03 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.561273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a064a-3ce2-4f0c-8e18-9e5f4c13ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.561597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a064a-3ce2-4f0c-8e18-9e5f4c13ad03 None admin] PATH_INFO: `/v3/projects/8e5816b5857f436c9249959b27e9764f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.562737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a064a-3ce2-4f0c-8e18-9e5f4c13ad03 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5816b5857f436c9249959b27e9764f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.564671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a064a-3ce2-4f0c-8e18-9e5f4c13ad03 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.566377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 423/838] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/projects/8e5816b5857f436c9249959b27e9764f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:16.572669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:16.675315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4b18d-72a1-4f67-9e54-c217f9fec8a5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:16.708953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:16.709562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:16.709846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:16.710111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:16.710819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=8e5816b5857f436c9249959b27e9764f, user.id=24ad0604011849a29f0e37f8178471c2) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:16.711120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:16.712542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69ac72-c01c-434e-848c-e7bd03f1feba None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:16.718313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 416/839] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:26:16 2022] GET /identity/v3/role_assignments?user.id=24ad0604011849a29f0e37f8178471c2&scope.project.id=8e5816b5857f436c9249959b27e9764f&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:18.870545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404b98-4ec2-4c1b-9986-63bd9cc11c57 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:18.871066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404b98-4ec2-4c1b-9986-63bd9cc11c57 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:18.871066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404b98-4ec2-4c1b-9986-63bd9cc11c57 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:18.872409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 424/840] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:18.878132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:18.878503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:18.878682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:18.897017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:18.898209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:18.925777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:18.962236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 417/841] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:19.235110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404b98-4ec2-4c1b-9986-63bd9cc11c57 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:19.332948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404b98-4ec2-4c1b-9986-63bd9cc11c57 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:19.365098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bf986-6bd1-43bf-8e2b-125b321dc159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:19.365737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf986-6bd1-43bf-8e2b-125b321dc159 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:19.366019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf986-6bd1-43bf-8e2b-125b321dc159 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:19.366288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf986-6bd1-43bf-8e2b-125b321dc159 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:19.367392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bf986-6bd1-43bf-8e2b-125b321dc159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:19.368793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bf986-6bd1-43bf-8e2b-125b321dc159 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:19.370329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 425/842] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:19.375833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:19.469963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73132c-76f2-46d3-9287-942bb5efca88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:19.503036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935976ba-c5ba-418f-a80c-fff87aaed69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:19.503565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935976ba-c5ba-418f-a80c-fff87aaed69d None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:19.503847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935976ba-c5ba-418f-a80c-fff87aaed69d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:19.504120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935976ba-c5ba-418f-a80c-fff87aaed69d None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:19.504771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935976ba-c5ba-418f-a80c-fff87aaed69d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:19.506205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935976ba-c5ba-418f-a80c-fff87aaed69d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:19.623126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 418/843] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:26:19 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:21.796285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf45f8-87f0-455b-93c0-636b6b9b86d6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:21.796826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf45f8-87f0-455b-93c0-636b6b9b86d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:21.796826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf45f8-87f0-455b-93c0-636b6b9b86d6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:21.798725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 426/844] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:21.803839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:21.804219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:21.804394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:21.822073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:21.823250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:21.839016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:21.887467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 419/845] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:22.162139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf45f8-87f0-455b-93c0-636b6b9b86d6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:22.195636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:22.259275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf45f8-87f0-455b-93c0-636b6b9b86d6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:22.291868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:22.292480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:22.292757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:22.293029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] PATH_INFO: `/v3/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:22.294403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] RBAC: Authorizing `identity:get_role(role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:22.295761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:22.297059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 427/846] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:22 2022] GET /identity/v3/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:22.302870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:22.398923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de349a-3c6f-46a0-9654-560d5e8cd7a9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:22.431036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:22.431583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:22.431861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:22.432133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] PATH_INFO: `/v3/users/3a7ced9698ca4135a0ae8d726cc84d80` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:22.444989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] RBAC: Authorizing `identity:get_user(user_id=3a7ced9698ca4135a0ae8d726cc84d80)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:22.446443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:22.447988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 420/847] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:22 2022] GET /identity/v3/users/3a7ced9698ca4135a0ae8d726cc84d80 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:22.453587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:22.547783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b10bf-9695-4286-a145-1fd1f96a8703 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:22.549239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:22.580201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9e3e-7bd1-48ac-853c-bc3b303f36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:22.580797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9e3e-7bd1-48ac-853c-bc3b303f36a6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:22.581069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9e3e-7bd1-48ac-853c-bc3b303f36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:22.581335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9e3e-7bd1-48ac-853c-bc3b303f36a6 None admin] PATH_INFO: `/v3/projects/8e5816b5857f436c9249959b27e9764f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:22.582443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd9e3e-7bd1-48ac-853c-bc3b303f36a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8e5816b5857f436c9249959b27e9764f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:22.583835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd9e3e-7bd1-48ac-853c-bc3b303f36a6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:22.585491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 428/848] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:22 2022] GET /identity/v3/projects/8e5816b5857f436c9249959b27e9764f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:22.591308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:22.603265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:22.687271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac279f-f180-4af8-8038-4d19d5d1d14e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:22.720303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b42cb6-b8da-4db5-bb0a-d3e54e0097ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:22.720937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42cb6-b8da-4db5-bb0a-d3e54e0097ca None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:22.721214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42cb6-b8da-4db5-bb0a-d3e54e0097ca None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:22.721488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b42cb6-b8da-4db5-bb0a-d3e54e0097ca None admin] PATH_INFO: `/v3/projects/8e5816b5857f436c9249959b27e9764f/users/3a7ced9698ca4135a0ae8d726cc84d80/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:22.723619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42cb6-b8da-4db5-bb0a-d3e54e0097ca None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5816b5857f436c9249959b27e9764f, user_id=3a7ced9698ca4135a0ae8d726cc84d80, role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:22.725031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b42cb6-b8da-4db5-bb0a-d3e54e0097ca None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:22.816275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 421/849] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:26:22 2022] PUT /identity/v3/projects/8e5816b5857f436c9249959b27e9764f/users/3a7ced9698ca4135a0ae8d726cc84d80/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:24.915893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277347a-57ff-4ae9-b4ee-b65832b39ab8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:24.916410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277347a-57ff-4ae9-b4ee-b65832b39ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:24.916410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277347a-57ff-4ae9-b4ee-b65832b39ab8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:24.917794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 429/850] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:24.922928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:24.923289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:24.923471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:24.940953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:24.942150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:25.001376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:25.005703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 422/851] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:25.277162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277347a-57ff-4ae9-b4ee-b65832b39ab8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:25.372977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277347a-57ff-4ae9-b4ee-b65832b39ab8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:25.406106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:25.406709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:25.406980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:25.407291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] PATH_INFO: `/v3/roles/e275c993797f4c7eb8ee1081d5088b3a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:25.408648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] RBAC: Authorizing `identity:get_role(role_id=e275c993797f4c7eb8ee1081d5088b3a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:25.410017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:25.411291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 430/852] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:25 2022] GET /identity/v3/roles/e275c993797f4c7eb8ee1081d5088b3a => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:25.416880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:25.511023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81a81e-4310-48ee-9eaa-bafeb2f2cee0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:25.543650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:25.544256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:25.544540 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:25.544811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] PATH_INFO: `/v3/users/3a7ced9698ca4135a0ae8d726cc84d80` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:25.545932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] RBAC: Authorizing `identity:get_user(user_id=3a7ced9698ca4135a0ae8d726cc84d80)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:25.547341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:25.548890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 423/853] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:25 2022] GET /identity/v3/users/3a7ced9698ca4135a0ae8d726cc84d80 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:25.554387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:25.593150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:25.650429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21501e-3630-4c23-85b8-301c8ae6cb17 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:25.682111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:25.682706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:25.682989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:25.683262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:25.747101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:25.748540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:25.785140 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:25.842974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 431/854] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:26:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:26:25.848869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:25.912671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:25.945234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6485b-c8b9-4c58-84fc-d08f965afe6e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:25.976832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e15b87-ebf9-4b3b-beeb-563960ecb7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:25.977433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e15b87-ebf9-4b3b-beeb-563960ecb7de None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:25.977735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e15b87-ebf9-4b3b-beeb-563960ecb7de None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:25.978022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e15b87-ebf9-4b3b-beeb-563960ecb7de None admin] PATH_INFO: `/v3/projects/8e5816b5857f436c9249959b27e9764f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:25.979107 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e15b87-ebf9-4b3b-beeb-563960ecb7de None admin] RBAC: Authorizing `identity:get_project(project_id=8e5816b5857f436c9249959b27e9764f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:25.980505 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e15b87-ebf9-4b3b-beeb-563960ecb7de None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:25.982101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 424/855] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:25 2022] GET /identity/v3/projects/8e5816b5857f436c9249959b27e9764f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:25.988728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:26.083312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30d2d-7b68-406d-92b9-933afdda4af3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:26.115767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:26.116346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:26.116624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:26.116895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:26.117634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] RBAC: Adding query filter params (role.id=e275c993797f4c7eb8ee1081d5088b3a, scope.project.id=8e5816b5857f436c9249959b27e9764f, user.id=3a7ced9698ca4135a0ae8d726cc84d80) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:26.117940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:26.119337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309d7d3-cbd6-4120-b67d-cf2749116959 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:26.124797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 432/856] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:26:25 2022] GET /identity/v3/role_assignments?user.id=3a7ced9698ca4135a0ae8d726cc84d80&scope.project.id=8e5816b5857f436c9249959b27e9764f&role.id=e275c993797f4c7eb8ee1081d5088b3a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:28.251854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc1389-2476-4672-abc7-e84edf37d63b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:28.252250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc1389-2476-4672-abc7-e84edf37d63b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:28.252397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc1389-2476-4672-abc7-e84edf37d63b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:28.253753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 425/857] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:28.258874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:28.259306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:28.259405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:28.265819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:28.278265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:28.279448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:28.344218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 433/858] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:28.609288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc1389-2476-4672-abc7-e84edf37d63b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:28.706864 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc1389-2476-4672-abc7-e84edf37d63b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:28.739057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e03ce-a3db-49ed-ba0f-96fa79db1f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:28.739664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e03ce-a3db-49ed-ba0f-96fa79db1f0d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:28.739944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e03ce-a3db-49ed-ba0f-96fa79db1f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:28.740217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e03ce-a3db-49ed-ba0f-96fa79db1f0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:28.741301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e03ce-a3db-49ed-ba0f-96fa79db1f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:28.742744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e03ce-a3db-49ed-ba0f-96fa79db1f0d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:28.744271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 426/859] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:28.749955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:28.841836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de292a-9560-42b4-b0b7-e6b5bac95679 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:28.869218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:28.873837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fd9df-e4a9-4794-a079-14fc42762de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:28.874441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd9df-e4a9-4794-a079-14fc42762de0 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:28.874714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd9df-e4a9-4794-a079-14fc42762de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:28.874982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd9df-e4a9-4794-a079-14fc42762de0 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:28.875616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fd9df-e4a9-4794-a079-14fc42762de0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:28.877570 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fd9df-e4a9-4794-a079-14fc42762de0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:28.965151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 434/860] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:26:28 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:31.099690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405804-76fe-4c82-8071-6625517571d1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:31.100237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405804-76fe-4c82-8071-6625517571d1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:31.100237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405804-76fe-4c82-8071-6625517571d1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:31.101615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 427/861] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:31.106723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:31.107126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:31.107265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:31.124576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:31.125799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:31.188720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 435/862] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:31.454611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9405804-76fe-4c82-8071-6625517571d1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:31.458356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:31.552425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9405804-76fe-4c82-8071-6625517571d1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:31.585701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deafae-1755-4cb8-9b22-3d98c464ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:31.586314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deafae-1755-4cb8-9b22-3d98c464ea90 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:31.586593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deafae-1755-4cb8-9b22-3d98c464ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:31.586863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deafae-1755-4cb8-9b22-3d98c464ea90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:31.587955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deafae-1755-4cb8-9b22-3d98c464ea90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:31.589363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deafae-1755-4cb8-9b22-3d98c464ea90 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:31.590923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 428/863] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:26:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:31.596735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:31.690879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4d93-efd5-4214-b4f2-70eb5ae4b6c1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:31.704010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:31.722744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc3ae2-2cc7-4d16-a5c3-2385a17e7e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:31.723281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc3ae2-2cc7-4d16-a5c3-2385a17e7e47 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:31.723559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc3ae2-2cc7-4d16-a5c3-2385a17e7e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:31.723838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc3ae2-2cc7-4d16-a5c3-2385a17e7e47 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:31.724528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc3ae2-2cc7-4d16-a5c3-2385a17e7e47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:31.725964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc3ae2-2cc7-4d16-a5c3-2385a17e7e47 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:31.826805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 436/864] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:26:31 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:33.967702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6581-66ba-4e9b-b6ed-241bf3a1559e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:33.968224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6581-66ba-4e9b-b6ed-241bf3a1559e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:33.968310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6581-66ba-4e9b-b6ed-241bf3a1559e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:33.970241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 429/865] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:33.975278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:33.975704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:33.975830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:33.993399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:33.994626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:34.057605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 437/866] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:34.326355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6581-66ba-4e9b-b6ed-241bf3a1559e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:34.395828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:34.425078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6581-66ba-4e9b-b6ed-241bf3a1559e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:34.458792 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:34.459401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:34.459680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:34.459952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:34.469664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:34.474406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:34.475511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:34.476576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 430/867] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:34.481682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:34.573270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:34.576086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3886e-2760-4c1d-82ab-bad1196920df None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:34.608815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:34.609661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:34.610112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:34.610750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:34.611432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:34.611769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:34.613136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:34.621068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 438/868] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:34.627243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:34.724043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce197-d137-466b-9cab-dcd4e5aab733 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:34.756294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:34.757725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:34.758359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:34.758638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:34.758910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] PATH_INFO: `/v3/users/22260e8bfe5c475bae65eac2a62c1d0b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:34.771766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] RBAC: Authorizing `identity:get_user(user_id=22260e8bfe5c475bae65eac2a62c1d0b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:34.773184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:34.774873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 431/869] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:34 2022] GET /identity/v3/users/22260e8bfe5c475bae65eac2a62c1d0b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:34.780438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:34.877925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ab2b-54ac-4812-8044-cd3969ced88d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:34.909341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fbdb-5337-4207-8342-9e2e7649e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:34.909982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fbdb-5337-4207-8342-9e2e7649e7be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:34.910263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fbdb-5337-4207-8342-9e2e7649e7be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:34.910560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fbdb-5337-4207-8342-9e2e7649e7be None admin] PATH_INFO: `/v3/projects/4b1c299200424997a137e3e25f593310` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:34.911676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fbdb-5337-4207-8342-9e2e7649e7be None admin] RBAC: Authorizing `identity:get_project(project_id=4b1c299200424997a137e3e25f593310)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:34.913090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fbdb-5337-4207-8342-9e2e7649e7be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:34.914747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 439/870] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:34 2022] GET /identity/v3/projects/4b1c299200424997a137e3e25f593310 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:34.920557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:35.016164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47fd2f-0154-48b5-9eb2-e12b5abf094d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:35.048923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c8b31-fe7b-43f1-8bb0-cb91facdcfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:35.049575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c8b31-fe7b-43f1-8bb0-cb91facdcfcb None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:35.049861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c8b31-fe7b-43f1-8bb0-cb91facdcfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:35.050130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c8b31-fe7b-43f1-8bb0-cb91facdcfcb None admin] PATH_INFO: `/v3/projects/4b1c299200424997a137e3e25f593310/users/22260e8bfe5c475bae65eac2a62c1d0b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:35.052012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c8b31-fe7b-43f1-8bb0-cb91facdcfcb None admin] RBAC: Authorizing `identity:create_grant(project_id=4b1c299200424997a137e3e25f593310, user_id=22260e8bfe5c475bae65eac2a62c1d0b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:35.053416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c8b31-fe7b-43f1-8bb0-cb91facdcfcb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:35.154061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 432/871] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:26:34 2022] PUT /identity/v3/projects/4b1c299200424997a137e3e25f593310/users/22260e8bfe5c475bae65eac2a62c1d0b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:37.242726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553cd9d-7bac-4e3f-afaf-5d8770e8d002 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:37.243188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553cd9d-7bac-4e3f-afaf-5d8770e8d002 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:37.243288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553cd9d-7bac-4e3f-afaf-5d8770e8d002 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:37.244585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 440/872] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:37.249876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:37.250907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:37.250997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:37.268643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:37.269829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:37.314285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:37.333817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 433/873] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:37.603677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553cd9d-7bac-4e3f-afaf-5d8770e8d002 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:37.633456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:37.700524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553cd9d-7bac-4e3f-afaf-5d8770e8d002 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:37.732673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:37.733311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:37.733609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:37.733879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:37.743915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:37.748559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:37.749653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:37.750882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 441/874] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:37.755558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:37.850081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76ceb-7845-419a-8260-a48eb7ada272 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:37.883022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:37.883555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:37.883831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:37.884101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:37.884758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:37.885061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:37.886443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:37.894379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 434/875] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:37.900136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:37.985457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:37.994297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef2aa6-3c65-4506-8b0a-fc49fd5833ee None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:38.025340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:38.025997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:38.026448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:38.026761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] PATH_INFO: `/v3/users/22260e8bfe5c475bae65eac2a62c1d0b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:38.028366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] RBAC: Authorizing `identity:get_user(user_id=22260e8bfe5c475bae65eac2a62c1d0b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:38.029851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:38.032025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 442/876] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:37 2022] GET /identity/v3/users/22260e8bfe5c475bae65eac2a62c1d0b => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:38.037562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:38.079434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:38.133322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac78cb-d0d3-48f0-8547-8e7fc7e84a79 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:38.165512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:38.166119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:38.166398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:38.166671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:38.232127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:38.233559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:38.273652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:38.326789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 435/877] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:26:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:26:38.333371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:38.428337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506f3d-156a-40d0-968c-6d195f851f36 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:38.459695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070bc45-1a1c-4b57-8092-df7af87090be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:38.460293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070bc45-1a1c-4b57-8092-df7af87090be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:38.460567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070bc45-1a1c-4b57-8092-df7af87090be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:38.460835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070bc45-1a1c-4b57-8092-df7af87090be None admin] PATH_INFO: `/v3/projects/4b1c299200424997a137e3e25f593310` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:38.461930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070bc45-1a1c-4b57-8092-df7af87090be None admin] RBAC: Authorizing `identity:get_project(project_id=4b1c299200424997a137e3e25f593310)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:38.463338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070bc45-1a1c-4b57-8092-df7af87090be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:38.464896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 443/878] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:38 2022] GET /identity/v3/projects/4b1c299200424997a137e3e25f593310 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:38.470794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:38.564766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475a20-2b67-4ce6-8fbf-f406712fd895 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:38.597312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:38.597920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:38.598196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:38.598465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:38.599166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=4b1c299200424997a137e3e25f593310, user.id=22260e8bfe5c475bae65eac2a62c1d0b) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:38.599467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:38.600861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd609659-fd09-4b9f-b468-4b400d14fa63 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:38.606310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 436/879] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:26:38 2022] GET /identity/v3/role_assignments?user.id=22260e8bfe5c475bae65eac2a62c1d0b&scope.project.id=4b1c299200424997a137e3e25f593310&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:40.743095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c1c2-6352-4ce0-aef8-c3d5b0f6cdba None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:40.743612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c1c2-6352-4ce0-aef8-c3d5b0f6cdba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:40.743612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c1c2-6352-4ce0-aef8-c3d5b0f6cdba None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:40.744959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 444/880] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:40.750114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022a94-644d-47a7-85f1-e1ca051599e8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:40.750510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022a94-644d-47a7-85f1-e1ca051599e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:40.751223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022a94-644d-47a7-85f1-e1ca051599e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:40.764017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:40.769608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-23022a94-644d-47a7-85f1-e1ca051599e8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:40.770789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-23022a94-644d-47a7-85f1-e1ca051599e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:40.834918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 437/881] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:41.102931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c1c2-6352-4ce0-aef8-c3d5b0f6cdba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:41.129890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:41.201173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c1c2-6352-4ce0-aef8-c3d5b0f6cdba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:41.234329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87d2c-72de-49d6-9b4e-3d83092c381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:41.235491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87d2c-72de-49d6-9b4e-3d83092c381e None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:41.235784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87d2c-72de-49d6-9b4e-3d83092c381e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:41.236049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87d2c-72de-49d6-9b4e-3d83092c381e None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:41.236706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87d2c-72de-49d6-9b4e-3d83092c381e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:41.238079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87d2c-72de-49d6-9b4e-3d83092c381e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:41.308753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 445/882] 10.222.0.26 () {60 vars in 1138 bytes} [Wed Nov 2 07:26:41 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:26:43.461521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f3e5-a25d-4e80-9948-db18599dae3f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:43.462059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f3e5-a25d-4e80-9948-db18599dae3f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:43.462172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224f3e5-a25d-4e80-9948-db18599dae3f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:43.463450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 438/883] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:43.468613 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:43.468972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:43.469666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:43.487830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:43.488955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:43.553062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 446/884] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:43.819155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224f3e5-a25d-4e80-9948-db18599dae3f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:43.917668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224f3e5-a25d-4e80-9948-db18599dae3f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:43.949813 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1588d-2618-4a0c-a792-dc9c36bd9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:43.950424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1588d-2618-4a0c-a792-dc9c36bd9bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:43.950706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1588d-2618-4a0c-a792-dc9c36bd9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:43.950982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1588d-2618-4a0c-a792-dc9c36bd9bb6 None admin] PATH_INFO: `/v3/domains/bf3780afa2064f9fa994dbcbad6f606d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:43.954093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:43.961763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1588d-2618-4a0c-a792-dc9c36bd9bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bf3780afa2064f9fa994dbcbad6f606d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:43.963212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1588d-2618-4a0c-a792-dc9c36bd9bb6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:43.970157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 439/885] 10.222.0.26 () {56 vars in 1183 bytes} [Wed Nov 2 07:26:43 2022] GET /identity/v3/domains/bf3780afa2064f9fa994dbcbad6f606d => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:43.971152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:43.987857 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:44.065211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a89de9-472b-40c0-a461-9a610e7e4aa5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:44.097257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a12620-509b-44e1-963b-b325176f238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:44.097868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12620-509b-44e1-963b-b325176f238c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:44.098145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12620-509b-44e1-963b-b325176f238c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:44.098415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a12620-509b-44e1-963b-b325176f238c None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:44.099046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a12620-509b-44e1-963b-b325176f238c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:44.100538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a12620-509b-44e1-963b-b325176f238c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:44.188884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 447/886] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:26:43 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:46.342081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03424b2-1b28-4f18-9fa8-7b985201a089 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.342580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03424b2-1b28-4f18-9fa8-7b985201a089 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.342668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03424b2-1b28-4f18-9fa8-7b985201a089 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.344002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 440/887] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:46.349238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.349653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.349819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.367301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.368455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.426630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:46.431691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 448/888] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:46.702475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03424b2-1b28-4f18-9fa8-7b985201a089 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.800052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03424b2-1b28-4f18-9fa8-7b985201a089 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.832099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e118-a25f-493d-afcb-850fae704813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.832666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e118-a25f-493d-afcb-850fae704813 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.832961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e118-a25f-493d-afcb-850fae704813 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.833229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e118-a25f-493d-afcb-850fae704813 None admin] PATH_INFO: `/v3/domains/bf3780afa2064f9fa994dbcbad6f606d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.834336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35e118-a25f-493d-afcb-850fae704813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bf3780afa2064f9fa994dbcbad6f606d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.835736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35e118-a25f-493d-afcb-850fae704813 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.837250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 441/889] 10.222.0.26 () {56 vars in 1183 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains/bf3780afa2064f9fa994dbcbad6f606d => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.843064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.936951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d1a0c-7e9a-446c-b73a-61d6b6aae196 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.968879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bd089-68af-4496-af94-a682701f3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.969411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd089-68af-4496-af94-a682701f3c35 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.969720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd089-68af-4496-af94-a682701f3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.969998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bd089-68af-4496-af94-a682701f3c35 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.970633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bd089-68af-4496-af94-a682701f3c35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.972032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bd089-68af-4496-af94-a682701f3c35 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.054364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 449/890] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:49.190025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed915d-8223-463b-91b3-f879f4c4bbb6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.190574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed915d-8223-463b-91b3-f879f4c4bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.190574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed915d-8223-463b-91b3-f879f4c4bbb6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.191893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 442/891] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:49.197068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.197430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.197644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.215542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:49.216706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:49.264474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:49.280992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 450/892] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:49.543219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed915d-8223-463b-91b3-f879f4c4bbb6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.603158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:49.642094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed915d-8223-463b-91b3-f879f4c4bbb6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.674632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.675241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.675523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.675795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.685442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:49.691240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:49.692299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:26:49.693304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 443/893] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:49.698332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.865601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a81154-6bfc-4fd9-bc06-1163b47785f1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.897959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.898549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.898824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.899091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.899736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:49.900034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.901374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.909038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 451/894] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:49.914952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.013288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753535c-e698-4e8a-a537-4edecd92a183 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.036025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:50.046602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.047760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.048065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.048342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] PATH_INFO: `/v3/users/b3dacacb4c284b17921d74227b784def` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.061297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b3dacacb4c284b17921d74227b784def)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.063223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.064794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 444/895] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/users/b3dacacb4c284b17921d74227b784def => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:50.070744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.115754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:50.166118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65382f-895a-465e-a243-ff4475bd99aa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.197560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d619974-60a8-46f8-aa1a-62190177c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.198164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d619974-60a8-46f8-aa1a-62190177c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.198431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d619974-60a8-46f8-aa1a-62190177c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.198695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d619974-60a8-46f8-aa1a-62190177c6bb None admin] PATH_INFO: `/v3/projects/eca4debee0344314a416ac9f489f2739` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.199778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d619974-60a8-46f8-aa1a-62190177c6bb None admin] RBAC: Authorizing `identity:get_project(project_id=eca4debee0344314a416ac9f489f2739)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.201176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d619974-60a8-46f8-aa1a-62190177c6bb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.202765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 452/896] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:50 2022] GET /identity/v3/projects/eca4debee0344314a416ac9f489f2739 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:50.208627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.306902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822895-a8f2-49c0-99b4-81b4d7bf12f0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.338811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa60be-3efe-408d-bda4-f871ec1bb0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.339451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa60be-3efe-408d-bda4-f871ec1bb0ad None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.339728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa60be-3efe-408d-bda4-f871ec1bb0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.339996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa60be-3efe-408d-bda4-f871ec1bb0ad None admin] PATH_INFO: `/v3/projects/eca4debee0344314a416ac9f489f2739/users/b3dacacb4c284b17921d74227b784def/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.341892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa60be-3efe-408d-bda4-f871ec1bb0ad None admin] RBAC: Authorizing `identity:create_grant(project_id=eca4debee0344314a416ac9f489f2739, user_id=b3dacacb4c284b17921d74227b784def, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.343304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa60be-3efe-408d-bda4-f871ec1bb0ad None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.398450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 445/897] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:26:50 2022] PUT /identity/v3/projects/eca4debee0344314a416ac9f489f2739/users/b3dacacb4c284b17921d74227b784def/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:52.484363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaae74-a2c4-4d11-bb5c-5350ddc325da None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.484865 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaae74-a2c4-4d11-bb5c-5350ddc325da None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.484865 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaae74-a2c4-4d11-bb5c-5350ddc325da None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.486199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 453/898] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:52.491210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.491634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.491757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.509831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:52.510995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:52.544800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:52.574232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 446/899] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:52.843860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaae74-a2c4-4d11-bb5c-5350ddc325da None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:52.940887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaae74-a2c4-4d11-bb5c-5350ddc325da None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:52.953393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:52.971587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:52.981480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.981480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.981480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.982508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:26:52.987702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:52.988851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:26:52.990101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 454/900] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:52.994598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.089051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1da7-acd7-4a6a-9040-afe852ad9ede None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.122101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.122639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.122919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.123192 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.123846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:53.124148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.125523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.133226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 447/901] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:53.139191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.233515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654ce9-125a-403a-9903-4fc1a83ec4b9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.265944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.266548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.266823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.267093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] PATH_INFO: `/v3/users/b3dacacb4c284b17921d74227b784def` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.268181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] RBAC: Authorizing `identity:get_user(user_id=b3dacacb4c284b17921d74227b784def)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.269619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.271163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 455/902] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Nov 2 07:26:53 2022] GET /identity/v3/users/b3dacacb4c284b17921d74227b784def => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:53.277034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.311123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:53.375095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323505-4bbc-4838-96d9-c8376f7e8293 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.407736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.408322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.408601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.408871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.472585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.474062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.504358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:53.567388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 448/903] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:26:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:26:53.573239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.616112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:53.669822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b9c4-e9d9-4114-b0bd-0a1ba20ad020 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.700559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19392b95-5788-41f9-82fa-844734307f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.701163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392b95-5788-41f9-82fa-844734307f97 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.701441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392b95-5788-41f9-82fa-844734307f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.701736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392b95-5788-41f9-82fa-844734307f97 None admin] PATH_INFO: `/v3/projects/eca4debee0344314a416ac9f489f2739` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.703337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19392b95-5788-41f9-82fa-844734307f97 None admin] RBAC: Authorizing `identity:get_project(project_id=eca4debee0344314a416ac9f489f2739)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.704763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19392b95-5788-41f9-82fa-844734307f97 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.706380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 456/904] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Nov 2 07:26:53 2022] GET /identity/v3/projects/eca4debee0344314a416ac9f489f2739 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:53.712479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.808256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d242b-acf8-4d72-98da-0d7344e7845a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.841466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.842098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.842372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.842634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.843337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=eca4debee0344314a416ac9f489f2739, user.id=b3dacacb4c284b17921d74227b784def) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:53.843636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.845026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7560a-9dd9-4938-8ab5-dceefded878c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.846745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:53.850957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 449/905] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:26:53 2022] GET /identity/v3/role_assignments?user.id=b3dacacb4c284b17921d74227b784def&scope.project.id=eca4debee0344314a416ac9f489f2739&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:03.696646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=45 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:03.879034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:05.342226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b5cb-c77b-45a1-9911-69085ce93347 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.342789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b5cb-c77b-45a1-9911-69085ce93347 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.342893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b5cb-c77b-45a1-9911-69085ce93347 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.344231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 457/906] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:05.349408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.349866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.350000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.368065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:05.374233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.433189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 450/907] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:05.709215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b5cb-c77b-45a1-9911-69085ce93347 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.807701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b5cb-c77b-45a1-9911-69085ce93347 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.839735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.840347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.840622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.840889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.851650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.853078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:05.867282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:05.868425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:05.874560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:05.874560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:05.874560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:05.874560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 458/908] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:05.874855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.972878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cfac9-162e-4324-83d8-f51522e9589b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.001018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:06.006846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.008869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.008869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.008869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.008869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:06.008869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.010213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef4df5-81ce-4480-8695-aad62478918f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.021435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 451/909] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:06.027195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.078293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:06.123910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b5fb5-2987-497f-8312-fbe7044dcc2d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.155781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb1451-7b40-490e-a5d7-610a0a274709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.156374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1451-7b40-490e-a5d7-610a0a274709 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.158344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1451-7b40-490e-a5d7-610a0a274709 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.158344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb1451-7b40-490e-a5d7-610a0a274709 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.158344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1451-7b40-490e-a5d7-610a0a274709 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.159537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb1451-7b40-490e-a5d7-610a0a274709 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.229153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 459/910] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Nov 2 07:28:06 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:08.395430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66580d2-0eb7-445c-9488-1ce9cc0fd226 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.395945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66580d2-0eb7-445c-9488-1ce9cc0fd226 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.395945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66580d2-0eb7-445c-9488-1ce9cc0fd226 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.397300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 452/911] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:08.402427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.402838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.403008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.420865 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:08.422084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.488009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 460/912] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:08.758762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66580d2-0eb7-445c-9488-1ce9cc0fd226 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.859802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66580d2-0eb7-445c-9488-1ce9cc0fd226 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.894264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.894883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.895158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.895460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.906272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:28:08.911649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:08.912824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:08.913711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 453/913] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:08.918767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.956211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.014513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ef29-4f9f-4767-92a7-5f7bf47c7608 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.046102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.046695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.046969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.047242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.047914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:09.048212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.050121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.057778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 461/914] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:09.063666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.114376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.162185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cccd3-d723-4c4b-9f67-0d4104808c0a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.195000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.195593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.195871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.196140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.206902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.208324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:09.222465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:09.223403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:09.225450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:09.225450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:09.225450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:09.225450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 454/915] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:09.229578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.324077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.326787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44060d39-d2a0-432d-af1a-61a4502613e9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.358529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.359124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.359401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.359675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.360303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:09.360604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.362012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.373711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 462/916] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:09.379630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.477651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75187f67-be51-460d-84f0-9184ee7741b7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.479221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.511486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.512103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.512383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.512657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.520483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.521941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:28:09.532926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:09.534072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:09.535353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 455/917] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:09.542101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.639627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f642ac4-9c06-420a-8041-9d016eb8d42a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.672677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.673271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.673559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.673851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.675056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:09.675356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.676760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.694133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 463/918] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:09.700174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.797058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb2461-544a-4a74-867c-61fd7c34e887 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.829890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.830502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.830778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.831045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.841317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.843482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:09.856499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:09.857400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:09.858297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:09.858297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:09.858297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:09.858297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 456/919] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:09.863892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.882881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.959243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe968d-bbd5-4f3b-9924-686e81325aab None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.992264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.992858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.993132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.993400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.994063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:09.994360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.995695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.007203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 464/920] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:10.012962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:10.029033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:10.110567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683beeb-7dc5-4850-b83d-2cd20fa30e0e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:10.144584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:10.145227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.145503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.145803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.152264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:10.153774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:28:10.166005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:10.167068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:10.167981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 457/921] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:10.173166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:10.251286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:10.271506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db1666-ed14-4159-93f0-169303d98047 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:10.304085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:10.304680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.304954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.305222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.305928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:10.306229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:10.307640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fdd86-56c4-4a16-9dd5-840b0d1dd0ef None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.318984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 465/922] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:10.325011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:10.398018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:10.421399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae441c-055f-42b8-8e47-bc3ddf2ff3d7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:10.452206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7ed63-3e4e-4feb-a825-feb9196d05a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:10.452842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7ed63-3e4e-4feb-a825-feb9196d05a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.453117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7ed63-3e4e-4feb-a825-feb9196d05a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.453385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7ed63-3e4e-4feb-a825-feb9196d05a7 None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/856250812d2b4bcdaa732efe4f7e9fad/roles/51691f2ea57b44b3997651c22824ce2d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.468113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7ed63-3e4e-4feb-a825-feb9196d05a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=856250812d2b4bcdaa732efe4f7e9fad, role_id=51691f2ea57b44b3997651c22824ce2d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:10.469565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7ed63-3e4e-4feb-a825-feb9196d05a7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.547778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 458/923] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:28:10 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/856250812d2b4bcdaa732efe4f7e9fad/roles/51691f2ea57b44b3997651c22824ce2d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:12.684336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a5045-fc23-466d-8e0e-b7a7134aa2c3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:12.684879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a5045-fc23-466d-8e0e-b7a7134aa2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:12.684879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a5045-fc23-466d-8e0e-b7a7134aa2c3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:12.686256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 466/924] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:12.692225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:12.692626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:12.692781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:12.710377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:12.711551 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:12.776847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 459/925] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:13.046739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a5045-fc23-466d-8e0e-b7a7134aa2c3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.145807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a5045-fc23-466d-8e0e-b7a7134aa2c3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.178936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.179558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.179837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.180111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.186725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:13.190349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:28:13.195137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:13.196055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:13.197135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 467/926] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:13.202363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.257399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:13.302130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f98c34-e022-490f-b816-7c3802e7e3ef None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.334528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.335144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.335426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.335699 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.336351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:13.336652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.338051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:13.346250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 460/927] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:13.352269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.452073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd27d2-49ab-4233-9ea4-115357a7672b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.485432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.486075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.486371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.486659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.496489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.497950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:13.512670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:13.518743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:13.519923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:13.519923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:13.519923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:13.519923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 468/928] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:13.520185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.617917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368eee-76d2-45f7-8a58-d38dcf998c81 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.633631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:13.651222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.651821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.652102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.652376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.653013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:13.653321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.654724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:13.666707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 461/929] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:13.672334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.722469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:13.772318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65882cda-9ed0-4c09-890e-9759f3260611 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.806699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.807308 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.807589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.807861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.816697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.818218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:28:13.829120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:13.830287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:13.831612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 469/930] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:13.836126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.932923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038da06-3947-402e-ad20-3569cbe1cee0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.966003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.966593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.966868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.967133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.967848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:13.968146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.969571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:14.100066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 462/931] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:14.106036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.202449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c5f4-0808-400c-bb9a-c444ae243a1a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:14.212782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.235941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:14.236571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:14.236851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:14.237123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:14.302090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:14.303565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:14.399123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 470/932] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:28:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:28:14.405010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.440024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.502675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21305e-5aa4-4548-b627-bacec79b6d10 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:14.537091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:14.537736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:14.538018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:14.538290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:14.548462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:14.549960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:14.563866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:14.565485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:14.566835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:14.566835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:14.566835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:14.566835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 463/933] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:14.571295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.583250 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.667002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897d47e-c6e7-4fbc-970f-7d0e3346ee55 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:14.701249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:14.701889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:14.702163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:14.702430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:14.703061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:14.703361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:14.704736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:14.716285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 471/934] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:14.722110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.804866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.819533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec9af-9126-4e19-901c-c47b22d44657 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:14.851730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:14.852337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:14.852608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:14.852874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:14.859096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:14.860503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:28:14.871092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:14.877818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:14.878882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 464/935] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:14.879463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.948226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.977197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9ce8-acf2-4ed6-9f31-ef4101a7f960 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:15.010615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:15.011207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:15.011486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:15.011760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:15.012440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:15.012745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:15.014191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fd00a-c41a-4fcd-a468-10b1cbcd5650 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:15.025788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 472/936] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:15.031956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:15.128103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40396fb-8417-479f-88ca-24435dc8b21b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:15.160259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:15.160853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:15.161133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:15.161403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:15.162160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] RBAC: Adding query filter params (role.id=51691f2ea57b44b3997651c22824ce2d, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=856250812d2b4bcdaa732efe4f7e9fad) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:15.162457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:15.163941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140883c-bfd6-446c-9c0f-8016b01747b0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:15.169624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 465/937] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:28:15 2022] GET /identity/v3/role_assignments?user.id=856250812d2b4bcdaa732efe4f7e9fad&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=51691f2ea57b44b3997651c22824ce2d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:17.348728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ffe1-e4d1-446c-acb8-59290f6c1c58 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.349239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ffe1-e4d1-446c-acb8-59290f6c1c58 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.349324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ffe1-e4d1-446c-acb8-59290f6c1c58 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.350640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 473/938] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:17.355806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.356197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.356352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.374458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:17.375627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:17.378921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:17.440517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 466/939] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:17.709052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ffe1-e4d1-446c-acb8-59290f6c1c58 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.809221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ffe1-e4d1-446c-acb8-59290f6c1c58 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.837020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:17.843899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.844512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.844797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.845074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.855685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:28:17.860501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:17.862119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:17.863275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 474/940] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:17.868204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.965961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fdff3-dd7c-4c50-b4d1-f7bae8d3ba28 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.999350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.999939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.000214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.000482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.001129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:18.001474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.002975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.011227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 467/941] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:18.017018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:18.115968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be768d-671d-41a4-a0ed-8f5136391d03 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:18.148970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.149670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.149947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.150216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.161105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.162562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:18.176429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:18.177482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:18.178758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:18.178758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:18.178758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:18.178758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 475/942] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:18.183348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:18.186254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:18.281800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efbb63-1771-472f-9303-b14816df3090 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:18.315092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.315681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.315957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.316223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.316854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:18.317151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.318595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.330495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 468/943] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:18.336174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:18.378382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:18.432370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac35b-227c-4d52-96d4-c85de44de895 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:18.464823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.465441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.465743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.466009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.473297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.474745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:28:18.486126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:18.487277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:18.488258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 476/944] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:18.493305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:18.553825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:18.590737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dbbfe-b66f-4f01-a83e-e1f26a18f8b7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:18.623212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.623809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.624086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.624353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.625070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:18.625397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.627336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.644419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 469/945] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:18.650352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:18.746665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee070e-3531-448b-ad5b-a4e5ffc6bd25 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:18.748159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:18.779444 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.780050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.780324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.780591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.790616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.792783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:18.806175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:18.807252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:18.808145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:18.808145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:18.808145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:18.808145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 477/946] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:18.813035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:18.910042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb88aa-765f-480b-bbd9-861e25ea17c6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:18.929526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:18.943953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.946507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.946507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.946507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.946507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:18.946507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.947452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.958463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 470/947] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:18.964363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:19.063080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e2bd-26dc-4680-87b1-afaab92ffd92 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:19.094421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:19.095032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:19.095800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:19.096069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:19.102471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:19.103893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:28:19.115876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:19.116904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:19.118067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 478/948] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:19.122830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:19.223386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864017db-04c6-4c88-abe2-0169b6f99d79 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:19.256747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:19.257335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:19.257643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:19.257912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:19.258591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:19.258888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:19.260287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45945af-fd16-4d6c-a5d1-c5ab6fed3ee8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:19.272793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 471/949] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:19.278840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:19.295171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:19.376486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877910ef-c7f4-4db0-ad21-6b47ebeba886 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:19.409839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32387a0e-0795-4719-8989-9dc1414de2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:19.410476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387a0e-0795-4719-8989-9dc1414de2da None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:19.410750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387a0e-0795-4719-8989-9dc1414de2da None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:19.411021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32387a0e-0795-4719-8989-9dc1414de2da None admin] PATH_INFO: `/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/856250812d2b4bcdaa732efe4f7e9fad/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:19.412861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32387a0e-0795-4719-8989-9dc1414de2da None admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d9161195b4ee0908523c82f5c3919, user_id=856250812d2b4bcdaa732efe4f7e9fad, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:19.414298 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32387a0e-0795-4719-8989-9dc1414de2da None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:19.536180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 479/950] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Nov 2 07:28:19 2022] PUT /identity/v3/projects/5b7d9161195b4ee0908523c82f5c3919/users/856250812d2b4bcdaa732efe4f7e9fad/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:21.658799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3bda-a210-4c81-8d81-3dac3ccbe666 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.659338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3bda-a210-4c81-8d81-3dac3ccbe666 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.659338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3bda-a210-4c81-8d81-3dac3ccbe666 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.660696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 472/951] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:21.666103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.666513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.666688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.684434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:21.686152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:21.749702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 480/952] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:22.024115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af3bda-a210-4c81-8d81-3dac3ccbe666 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.065828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:22.121925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af3bda-a210-4c81-8d81-3dac3ccbe666 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.154997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.155616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.155894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.156159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.165773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:28:22.170478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:22.171654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:22.172751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 473/953] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:22.177589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.180707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:22.273313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400e2dd-9134-4ac0-82d4-6d4a63ea756f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.306217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.306754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.307034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.307309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.307965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:22.308268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.309705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.317981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 481/954] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:22.323888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.418495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:22.421291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5994f-58e2-4292-8e0d-b82f00bd7267 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.453494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.454130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.454408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.454676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.464785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.466237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:22.479679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:22.480842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:22.481859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:22.481859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:22.481859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:22.481859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 474/955] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:22.486554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.552111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:22.589413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181615d-c675-4fc1-81fa-f0439ad35843 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.616435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.617029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.617303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.617593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.618271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:22.618530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.619862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.632087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 482/956] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:22.637797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.735507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00422c6-b492-41a2-a7e3-8b69d3fee830 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.768915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.769531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.769841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.770115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.777184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.778644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:28:22.789953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:22.791043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:22.792362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 475/957] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:22.796969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.893607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f18093-afdd-4f23-86ec-42944347bcda None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.917805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:22.926468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.927054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.927327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.927595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.928302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:22.928605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.930034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.946869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 483/958] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:28:22.952826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.967729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:23.051774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71050fea-b9bf-4f62-88ca-effed010522b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:23.083346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:23.083938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.084216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.084488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.152492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:23.153870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:23.167844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:23.249151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 476/959] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:28:23.254913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:23.349282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dbf3d-df6f-49ae-97da-33a1a3df7ab8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:23.381383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:23.382011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.382287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.382557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.392100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:23.394139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:28:23.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:23.409863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:28:23.410736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:28:23.410736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:28:23.410736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:23.410736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 484/960] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:23.415470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:23.512196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12071a23-3194-4e0c-abaf-da64582cc120 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:23.525222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:23.545755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:23.546347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.546621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.546889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.547514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:23.547815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:23.549237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:23.559977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 477/961] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Nov 2 07:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:23.566172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:23.600366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:23.661605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8f809-3e05-40ce-8a9e-e0e87d42d4e0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:23.694130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:23.694862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.695134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.695403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.701711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:23.703112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:28:23.714428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:23.717346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Nov 02 07:28:23.718477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 485/962] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Nov 2 07:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:23.721270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:23.818484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d320fc-68f2-4666-838a-c3b1fd89eb03 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:23.850561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:23.851147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.851422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.851688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.852361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:23.852656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:23.854094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6691e13-8df5-48b4-ac5a-c06f935f87d0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:23.865895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 478/963] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Nov 2 07:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:23.872003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:23.962690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:23.968547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831470e7-be03-4d0e-8612-b3564b6265dd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:24.000585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:24.001182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:24.001459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:24.001751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:24.002466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] RBAC: Adding query filter params (role.id=ad25590df6c74ef39a4e887754ee34ab, scope.project.id=5b7d9161195b4ee0908523c82f5c3919, user.id=856250812d2b4bcdaa732efe4f7e9fad) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:24.008697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:24.008697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e427ece-fc8e-4453-bc0d-3fc97d1fe90e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:24.010641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 486/964] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Nov 2 07:28:23 2022] GET /identity/v3/role_assignments?user.id=856250812d2b4bcdaa732efe4f7e9fad&scope.project.id=5b7d9161195b4ee0908523c82f5c3919&role.id=ad25590df6c74ef39a4e887754ee34ab => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:26.152961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb159-807f-49c9-aa62-cdaf7625891d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:26.153520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb159-807f-49c9-aa62-cdaf7625891d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:26.153520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb159-807f-49c9-aa62-cdaf7625891d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:26.155009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 479/965] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:26.160937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:26.161372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:26.161500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:26.179405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:26.180602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:26.247334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 487/966] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:26.517055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb159-807f-49c9-aa62-cdaf7625891d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:26.547560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:26.614650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb159-807f-49c9-aa62-cdaf7625891d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:26.649375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:26.650014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:26.650289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:26.650558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:26.651127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:26.652501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:26.660993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:26.662196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:26.663043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 480/967] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:28:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:26.668421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:26.756556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:26.765702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4d39f-0ab1-4a62-ae7d-42f9c133981d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:26.800704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:26.801263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:26.801559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:26.801827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:26.802450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:26.802753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:26.804108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f502b0a-720b-4fa1-bf13-7cf058b3c297 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:26.808994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 488/968] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Nov 2 07:28:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:26.815534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:26.907545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:26.913263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591d25d-fb47-46eb-a271-cdbd09a36be6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:26.945454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:26.946086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:26.946364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:26.946633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:26.947250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:26.947552 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:26.948903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b21857-34e6-4d79-aad1-b93a55d5d83b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:26.953129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 481/969] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Nov 2 07:28:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:29.090086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633cd2c-bd0f-4639-8f58-d86011810307 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.090638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633cd2c-bd0f-4639-8f58-d86011810307 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.090638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633cd2c-bd0f-4639-8f58-d86011810307 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.092002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 489/970] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:29.097836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a78f-e9f9-4f89-b5ec-666b3dc10a0e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.103640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a78f-e9f9-4f89-b5ec-666b3dc10a0e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.103640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a78f-e9f9-4f89-b5ec-666b3dc10a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.116836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7af0a78f-e9f9-4f89-b5ec-666b3dc10a0e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:29.118114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7af0a78f-e9f9-4f89-b5ec-666b3dc10a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:29.183568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 482/971] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:28:29.450369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633cd2c-bd0f-4639-8f58-d86011810307 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:29.548015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633cd2c-bd0f-4639-8f58-d86011810307 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:29.580987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66491a06-867f-4c4f-a921-2d2c6e413bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:29.581599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66491a06-867f-4c4f-a921-2d2c6e413bec None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.581876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66491a06-867f-4c4f-a921-2d2c6e413bec None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.582141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66491a06-867f-4c4f-a921-2d2c6e413bec None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.582774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66491a06-867f-4c4f-a921-2d2c6e413bec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:29.584162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66491a06-867f-4c4f-a921-2d2c6e413bec None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:29.693732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 490/972] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Nov 2 07:28:29 2022] POST /identity/v3/services => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:31.850210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c2bf-c5a7-4039-9413-339c1dba5a7b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:31.850847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c2bf-c5a7-4039-9413-339c1dba5a7b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:31.850847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c2bf-c5a7-4039-9413-339c1dba5a7b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:31.852097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 483/973] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:31.857383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:31.857789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:31.857964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:31.876067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:31.877294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:31.886571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:31.947340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 491/974] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:32.213647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463c2bf-c5a7-4039-9413-339c1dba5a7b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:32.304000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:32.316074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463c2bf-c5a7-4039-9413-339c1dba5a7b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:32.350141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:32.350762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:32.351038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:32.351309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:32.351886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:32.353237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:32.361764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:32.362795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:32.363643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 484/975] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:28:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:32.369083 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:32.464649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610d1c8-69dc-43ed-b5c3-9ab746d0fe17 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:32.497459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:32.498082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:32.498355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:32.498620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:32.499276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:32.499572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:32.500910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:32.506731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 492/976] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Nov 2 07:28:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:28:32.512789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:32.610113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5685dfe-0a71-4c14-92d5-ea2a3dc221e9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:32.644277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:32.644873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:32.645150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:32.645419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:32.646146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] RBAC: Adding query filter params (interface=public, service_id=43b9e6f25fb941e5956f93e781751290, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:32.646457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:32.647832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd86d2c-5057-4ba9-928b-c7db7f162f7c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:32.652734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 485/977] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Nov 2 07:28:32 2022] GET /identity/v3/endpoints?service_id=43b9e6f25fb941e5956f93e781751290&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:32.658512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:32.662397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:32.766615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b834-9811-41d2-9847-a050f9398292 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:32.803133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b798e-e04e-48c4-84e1-38f4e4e66417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:32.803761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b798e-e04e-48c4-84e1-38f4e4e66417 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:32.804043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b798e-e04e-48c4-84e1-38f4e4e66417 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:32.804320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b798e-e04e-48c4-84e1-38f4e4e66417 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:32.804936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b798e-e04e-48c4-84e1-38f4e4e66417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:32.806366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b798e-e04e-48c4-84e1-38f4e4e66417 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:32.814006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 493/978] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Nov 2 07:28:32 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:34.979396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047e0c-a055-47f8-aff2-ab8b199b04e8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:34.979936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047e0c-a055-47f8-aff2-ab8b199b04e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:34.979936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57047e0c-a055-47f8-aff2-ab8b199b04e8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:34.981270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 486/979] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:28:34.986562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:34.986997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:34.987121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:35.005824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:35.011751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:35.066258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:35.071473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 494/980] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:28:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:28:35.337177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047e0c-a055-47f8-aff2-ab8b199b04e8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:35.356637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:35.436966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57047e0c-a055-47f8-aff2-ab8b199b04e8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:35.469057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:35.469692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:35.469973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:35.470238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:35.471365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:35.472698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:28:35.481182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:28:35.483782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Nov 02 07:28:35.484826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 487/981] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Nov 2 07:28:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:28:35.488923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:35.584171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbaa7f-0f1f-40d8-b564-00a2d7dd6bb7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:35.617197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:35.617758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:35.618033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:35.618302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:35.618915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:35.619214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:35.620559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa9eba-2536-4893-ab9a-ecaafb7fa8fc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:35.625436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 495/982] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Nov 2 07:28:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:35.631988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:35.712725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:35.730073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6b4a-c596-4dd2-a858-457a26f94c3d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:35.762781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017efb5-0a86-4cf5-bc0c-b2d50c0453a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:35.763370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017efb5-0a86-4cf5-bc0c-b2d50c0453a0 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:35.763649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017efb5-0a86-4cf5-bc0c-b2d50c0453a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:35.763922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017efb5-0a86-4cf5-bc0c-b2d50c0453a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:35.764589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017efb5-0a86-4cf5-bc0c-b2d50c0453a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:35.765966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017efb5-0a86-4cf5-bc0c-b2d50c0453a0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:35.892841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 488/983] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:45.622527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=69 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:45.888036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:52.505314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbaffb-c44d-409d-8367-48d145934920 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:52.505807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbaffb-c44d-409d-8367-48d145934920 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:52.505886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbaffb-c44d-409d-8367-48d145934920 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:52.512630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbec50-c90e-4571-8d10-c22bf2f64a62 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:52.513024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbec50-c90e-4571-8d10-c22bf2f64a62 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:52.513213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbec50-c90e-4571-8d10-c22bf2f64a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:52.517668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 496/984] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:34:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:52.613519 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4fbbec50-c90e-4571-8d10-c22bf2f64a62 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:52.614889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4fbbec50-c90e-4571-8d10-c22bf2f64a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:52.786702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 489/985] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:53.081872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0eb2-94b4-402a-82c5-c8badf4e8686 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.082556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0eb2-94b4-402a-82c5-c8badf4e8686 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.083068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0eb2-94b4-402a-82c5-c8badf4e8686 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.085413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 497/986] 10.222.0.26 () {54 vars in 965 bytes} [Wed Nov 2 07:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:53.092415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26e8a-2578-4c3c-ac21-7d95bc16b337 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.092880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26e8a-2578-4c3c-ac21-7d95bc16b337 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.093150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26e8a-2578-4c3c-ac21-7d95bc16b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.197831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f3c26e8a-2578-4c3c-ac21-7d95bc16b337 None None] MFA Rules not processed for user `94d217e156e944c3ba7dbbab90344e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:53.199179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f3c26e8a-2578-4c3c-ac21-7d95bc16b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.233408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:53.304703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 490/987] 10.222.0.26 () {58 vars in 1062 bytes} [Wed Nov 2 07:34:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:53.314053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0eb2-94b4-402a-82c5-c8badf4e8686 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:53.316184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6eee0eb2-94b4-402a-82c5-c8badf4e8686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.444169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0eb2-94b4-402a-82c5-c8badf4e8686 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:53.529222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:53.529885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.530158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.530426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.532012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.594150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:53.657120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:53.658745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0358-2a2e-4e6b-82da-30d5b76b9a84 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:53.679660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 498/988] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:56.156760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360548-1eec-4e83-bc11-b3dd357004bc None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:56.157324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360548-1eec-4e83-bc11-b3dd357004bc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:56.157324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360548-1eec-4e83-bc11-b3dd357004bc None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:56.158779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 491/989] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:56.164840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edc58-89db-4928-9471-71eb0521d05e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:56.165377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edc58-89db-4928-9471-71eb0521d05e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:56.165566 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3edc58-89db-4928-9471-71eb0521d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:56.249818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8d3edc58-89db-4928-9471-71eb0521d05e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:56.251054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8d3edc58-89db-4928-9471-71eb0521d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:56.349238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 499/990] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:56.634874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e360548-1eec-4e83-bc11-b3dd357004bc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:56.636404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e360548-1eec-4e83-bc11-b3dd357004bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:56.737785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e360548-1eec-4e83-bc11-b3dd357004bc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:56.807495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:56.809771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:56.810372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:56.810652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:56.810922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:56.812499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:56.921378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:56.922765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ea58-10c0-49ee-9126-b542064e7ce3 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:56.940567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 492/991] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:59.571796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57095db7-43fb-4807-b12c-feaf43bdd59e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:59.572313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57095db7-43fb-4807-b12c-feaf43bdd59e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:59.572313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57095db7-43fb-4807-b12c-feaf43bdd59e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:59.573631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 500/992] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:59.578980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9fec5-57b5-4687-b3fa-f1947beac4f6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:59.579371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9fec5-57b5-4687-b3fa-f1947beac4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:59.579558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9fec5-57b5-4687-b3fa-f1947beac4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:59.642963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-27f9fec5-57b5-4687-b3fa-f1947beac4f6 None None] MFA Rules not processed for user `f92a7df2f1e64a229f21b941d7cd789e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:59.644141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-27f9fec5-57b5-4687-b3fa-f1947beac4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:59.694952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:59.738479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 493/993] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:34:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:35:00.024389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57095db7-43fb-4807-b12c-feaf43bdd59e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:00.025958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57095db7-43fb-4807-b12c-feaf43bdd59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:00.036197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:00.125857 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57095db7-43fb-4807-b12c-feaf43bdd59e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:00.196521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:00.197110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:00.197382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:00.197679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:00.199209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:00.259619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:00.304904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:00.306343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01863672-7566-4939-a5f0-66f653c3e896 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:00.324713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 501/994] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:03.274742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6efebd-61ce-4317-b489-eb73537a72a4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:03.275232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6efebd-61ce-4317-b489-eb73537a72a4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:03.275328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6efebd-61ce-4317-b489-eb73537a72a4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:03.276627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 494/995] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:03.281913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765a52-6f39-44d3-bf64-a0758ebeb70b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:03.282346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765a52-6f39-44d3-bf64-a0758ebeb70b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:03.282452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765a52-6f39-44d3-bf64-a0758ebeb70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:03.346742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-96765a52-6f39-44d3-bf64-a0758ebeb70b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:03.347918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-96765a52-6f39-44d3-bf64-a0758ebeb70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:03.439140 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 502/996] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:03.720953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6efebd-61ce-4317-b489-eb73537a72a4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:03.722499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1b6efebd-61ce-4317-b489-eb73537a72a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:03.822196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6efebd-61ce-4317-b489-eb73537a72a4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:03.894437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:03.895608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:03.895890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:03.896166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:03.897775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:03.904633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:04.005799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:04.007157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ccff5-ef19-4148-8d20-c891983cf2f5 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:04.025665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 495/997] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:07.145886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43920fa-6e6b-442a-b524-f09d626d5f29 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.146443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43920fa-6e6b-442a-b524-f09d626d5f29 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.146443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43920fa-6e6b-442a-b524-f09d626d5f29 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.147818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 503/998] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:07.153232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d2fd-a624-4975-b6e6-676a67bc5b73 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.153662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d2fd-a624-4975-b6e6-676a67bc5b73 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.153917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d2fd-a624-4975-b6e6-676a67bc5b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.227346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4337d2fd-a624-4975-b6e6-676a67bc5b73 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:07.228646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4337d2fd-a624-4975-b6e6-676a67bc5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:07.289596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:07.335581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 496/999] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:07.634827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c16e3-48d2-40aa-addd-1f6b864278f9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.635220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c16e3-48d2-40aa-addd-1f6b864278f9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.635562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c16e3-48d2-40aa-addd-1f6b864278f9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.637041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 504/1000] 10.222.0.26 () {54 vars in 965 bytes} [Wed Nov 2 07:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:07.642729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061ab82-45e0-4195-943b-71a7ac59004c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.643084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061ab82-45e0-4195-943b-71a7ac59004c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.643426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061ab82-45e0-4195-943b-71a7ac59004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.718208 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d061ab82-45e0-4195-943b-71a7ac59004c None None] MFA Rules not processed for user `94d217e156e944c3ba7dbbab90344e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:07.719330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d061ab82-45e0-4195-943b-71a7ac59004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:07.796386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 497/1001] 10.222.0.26 () {58 vars in 1062 bytes} [Wed Nov 2 07:35:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:35:07.805427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c16e3-48d2-40aa-addd-1f6b864278f9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:07.806961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d8c16e3-48d2-40aa-addd-1f6b864278f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:07.827317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:07.912506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c16e3-48d2-40aa-addd-1f6b864278f9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:07.986085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:07.986616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:07.986930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:07.987195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:07.989240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:08.058865 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:08.096466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:08.097919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f0496-58a0-4ad5-9fd8-123cfe3d5bd3 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:08.115951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 505/1002] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:10.530079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889e95-ea1b-4cc4-818e-9d376d5c8f5a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:10.530580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889e95-ea1b-4cc4-818e-9d376d5c8f5a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:10.530580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889e95-ea1b-4cc4-818e-9d376d5c8f5a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:10.531880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 498/1003] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:10.537840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07dd1-10ae-41ec-b08c-5e39b3a364bd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:10.538241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07dd1-10ae-41ec-b08c-5e39b3a364bd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:10.538386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07dd1-10ae-41ec-b08c-5e39b3a364bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:10.604586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0c07dd1-10ae-41ec-b08c-5e39b3a364bd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:10.605794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0c07dd1-10ae-41ec-b08c-5e39b3a364bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:10.703548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 506/1004] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:10.994682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889e95-ea1b-4cc4-818e-9d376d5c8f5a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:10.996300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-38889e95-ea1b-4cc4-818e-9d376d5c8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:11.057794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:11.102554 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889e95-ea1b-4cc4-818e-9d376d5c8f5a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:11.177165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:11.177786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:11.178064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:11.178339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:11.179918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:11.296461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:11.298798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:11.300232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe036a-88f8-4765-9e2c-603d01077261 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:11.318371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 499/1005] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:13.529192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52417-ba77-41b5-a24a-fa2a7deca0e8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:13.529677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52417-ba77-41b5-a24a-fa2a7deca0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:13.529784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52417-ba77-41b5-a24a-fa2a7deca0e8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:13.531163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 507/1006] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:13.537448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc363-5255-4140-8b5c-dc78690df2eb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:13.537959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc363-5255-4140-8b5c-dc78690df2eb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:13.538037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc363-5255-4140-8b5c-dc78690df2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:13.607593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d0bfc363-5255-4140-8b5c-dc78690df2eb None None] MFA Rules not processed for user `f92a7df2f1e64a229f21b941d7cd789e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:13.608822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0bfc363-5255-4140-8b5c-dc78690df2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:13.708274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 500/1007] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:13.990769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db52417-ba77-41b5-a24a-fa2a7deca0e8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:13.992267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5db52417-ba77-41b5-a24a-fa2a7deca0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:14.022922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:14.094437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db52417-ba77-41b5-a24a-fa2a7deca0e8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:14.170344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:14.170607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:14.170884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:14.171153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:14.172730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:14.254691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:14.288731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:14.290302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d6ed1-af1c-4a5b-91d3-1273719930b5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:14.314822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 508/1008] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:13 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:16.843665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e0b45-f245-4357-b03d-3862d6661072 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:16.844219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e0b45-f245-4357-b03d-3862d6661072 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:16.844219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e0b45-f245-4357-b03d-3862d6661072 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:16.845644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 501/1009] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:16.851271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac619f-57dd-4d3c-8a86-bac66604edaf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:16.851271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac619f-57dd-4d3c-8a86-bac66604edaf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:16.851750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac619f-57dd-4d3c-8a86-bac66604edaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:16.915697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-97ac619f-57dd-4d3c-8a86-bac66604edaf None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:16.916874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97ac619f-57dd-4d3c-8a86-bac66604edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:17.010623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 509/1010] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:17.287702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e0b45-f245-4357-b03d-3862d6661072 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:17.289220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ea3e0b45-f245-4357-b03d-3862d6661072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:17.357839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:17.391195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e0b45-f245-4357-b03d-3862d6661072 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:17.462623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:17.463209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:17.463513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:17.463781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:17.465326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:17.569529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:17.570900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571e6c-beb5-489c-8e24-a1211534fff6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:17.580627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:17.588809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 502/1011] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:19.767992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b4dc-0b84-4b5b-b519-b13a0395c2d2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:19.768489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b4dc-0b84-4b5b-b519-b13a0395c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:19.768489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339b4dc-0b84-4b5b-b519-b13a0395c2d2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:19.769857 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 510/1012] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:19.775203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6139-2182-4061-8a45-607c67a32335 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:19.775577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6139-2182-4061-8a45-607c67a32335 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:19.775744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6139-2182-4061-8a45-607c67a32335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:19.840150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-768b6139-2182-4061-8a45-607c67a32335 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:19.841407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-768b6139-2182-4061-8a45-607c67a32335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:19.935512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 503/1013] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:20.218649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339b4dc-0b84-4b5b-b519-b13a0395c2d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:20.220177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c339b4dc-0b84-4b5b-b519-b13a0395c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:20.259976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:20.321844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339b4dc-0b84-4b5b-b519-b13a0395c2d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:20.393313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:20.394538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:20.394812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:20.395080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:20.396625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:20.476144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:20.500606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:20.502342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c041c91-c467-4bc4-8a59-6415886275f9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:20.521277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 511/1014] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:23.231349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddabe8-6e98-4c0c-b646-c11a57ef3e86 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:23.231752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddabe8-6e98-4c0c-b646-c11a57ef3e86 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:23.231931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddabe8-6e98-4c0c-b646-c11a57ef3e86 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:23.233310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 504/1015] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:23.238915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22e71-7838-4e22-999c-a91a42ee9ce7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:23.239343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22e71-7838-4e22-999c-a91a42ee9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:23.239451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22e71-7838-4e22-999c-a91a42ee9ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:23.305244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cde22e71-7838-4e22-999c-a91a42ee9ce7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:23.306475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cde22e71-7838-4e22-999c-a91a42ee9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:23.400428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 512/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:23.682559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddabe8-6e98-4c0c-b646-c11a57ef3e86 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:23.684093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bdddabe8-6e98-4c0c-b646-c11a57ef3e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:23.758178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:23.785499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddabe8-6e98-4c0c-b646-c11a57ef3e86 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:23.859046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:23.859644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:23.859919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:23.860188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:23.861781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:23.968125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:23.969461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c0a4-aa5b-4291-a89f-87f9340da24c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:23.987359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 505/1017] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:28.334474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d968-4025-4436-a22e-9fb5e23af7cd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.335028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d968-4025-4436-a22e-9fb5e23af7cd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.335028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d968-4025-4436-a22e-9fb5e23af7cd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.336399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 513/1018] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:28.341905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dc3ae-d60e-4705-acad-d9d40328fc97 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.342305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dc3ae-d60e-4705-acad-d9d40328fc97 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.342454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dc3ae-d60e-4705-acad-d9d40328fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.347881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:28.408903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e49dc3ae-d60e-4705-acad-d9d40328fc97 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:28.410104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e49dc3ae-d60e-4705-acad-d9d40328fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:28.507360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 506/1019] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:28.785202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d968-4025-4436-a22e-9fb5e23af7cd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:28.786789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1960d968-4025-4436-a22e-9fb5e23af7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:28.835424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:28.889897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d968-4025-4436-a22e-9fb5e23af7cd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:28.962042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:28.962637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:28.962909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:28.963171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:28.964725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:29.055592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:29.071150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:29.072595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b4e66-67eb-445b-9726-670c304aec5c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:29.090864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 514/1020] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:32.265257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4adb9f-154a-45ae-90c6-377695034fa1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:32.265802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4adb9f-154a-45ae-90c6-377695034fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:32.265913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4adb9f-154a-45ae-90c6-377695034fa1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:32.267220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 507/1021] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:32.272653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca231bf-098b-4181-90aa-182783d6b78a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:32.273062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca231bf-098b-4181-90aa-182783d6b78a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:32.273339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca231bf-098b-4181-90aa-182783d6b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:32.340272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fca231bf-098b-4181-90aa-182783d6b78a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:32.341454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fca231bf-098b-4181-90aa-182783d6b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:32.439942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 515/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:32.724917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4adb9f-154a-45ae-90c6-377695034fa1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:32.726524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c4adb9f-154a-45ae-90c6-377695034fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:32.813410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:32.829269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4adb9f-154a-45ae-90c6-377695034fa1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:32.913576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:32.914243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:32.914523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:32.914791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:32.916758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:33.040043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:33.041482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea13c4-0194-490a-b522-aa88d3a61619 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:33.060296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 508/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:37.338721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ddeea-642e-446e-9b78-4da81790629c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:37.339251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ddeea-642e-446e-9b78-4da81790629c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:37.339251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ddeea-642e-446e-9b78-4da81790629c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:37.340683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 516/1024] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:37.345881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f3546-97da-4eb4-823e-40876493ca03 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:37.346351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f3546-97da-4eb4-823e-40876493ca03 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:37.346519 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f3546-97da-4eb4-823e-40876493ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:37.363154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:37.420732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-888f3546-97da-4eb4-823e-40876493ca03 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:37.422056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-888f3546-97da-4eb4-823e-40876493ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:37.519833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 509/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:37.800635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ddeea-642e-446e-9b78-4da81790629c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:37.802172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a47ddeea-642e-446e-9b78-4da81790629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:37.859839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:37.904893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ddeea-642e-446e-9b78-4da81790629c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:37.975325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:37.975917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:37.976193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:37.976468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:37.978046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:38.084207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:38.087660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:38.089075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564e009-4108-4bf4-9770-0f69f4bdb094 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:38.107101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 517/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:42.978165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24c32-dbf3-4d85-a387-edc8eb958edb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:42.978961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24c32-dbf3-4d85-a387-edc8eb958edb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:42.979382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24c32-dbf3-4d85-a387-edc8eb958edb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:42.981112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 510/1027] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:42.988338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2683eb-b71c-41b6-bcb4-bc7fd38de47c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:42.988743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2683eb-b71c-41b6-bcb4-bc7fd38de47c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:42.988949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2683eb-b71c-41b6-bcb4-bc7fd38de47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:43.135552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5e2683eb-b71c-41b6-bcb4-bc7fd38de47c None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:43.136752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5e2683eb-b71c-41b6-bcb4-bc7fd38de47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:43.260592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 518/1028] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:35:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:47.326532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8bdac-c94f-4778-87bb-c08b5ba87395 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:47.327033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8bdac-c94f-4778-87bb-c08b5ba87395 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:47.327112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8bdac-c94f-4778-87bb-c08b5ba87395 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:47.328574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 511/1029] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:47.334132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e274-38eb-4224-988f-cafb37dc198d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:47.334616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e274-38eb-4224-988f-cafb37dc198d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:47.334891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e274-38eb-4224-988f-cafb37dc198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:47.396094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:47.420179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e519e274-38eb-4224-988f-cafb37dc198d None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:47.421691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e519e274-38eb-4224-988f-cafb37dc198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:47.518577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=59 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:47.533212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 519/1030] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:35:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:48.843186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7e355-451e-41c8-a404-4fa0554a3456 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:48.843728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7e355-451e-41c8-a404-4fa0554a3456 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:48.843728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7e355-451e-41c8-a404-4fa0554a3456 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:48.845062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 512/1031] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:48.850201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aa87-edc2-4f30-a0b4-17122be20e1f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:48.850624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aa87-edc2-4f30-a0b4-17122be20e1f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:48.850742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aa87-edc2-4f30-a0b4-17122be20e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:48.931271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4086aa87-edc2-4f30-a0b4-17122be20e1f None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:48.932466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4086aa87-edc2-4f30-a0b4-17122be20e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:48.974413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:49.039333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 520/1032] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:35:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:52.661416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994833-8fae-4b32-8e78-c8a1fdb6f41a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:52.661986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994833-8fae-4b32-8e78-c8a1fdb6f41a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:52.662202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994833-8fae-4b32-8e78-c8a1fdb6f41a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:52.663618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 513/1033] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:52.669247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bcee1-f0aa-4798-98de-2a7afe834bc9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:52.670149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bcee1-f0aa-4798-98de-2a7afe834bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:52.670699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bcee1-f0aa-4798-98de-2a7afe834bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:52.740350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c51bcee1-f0aa-4798-98de-2a7afe834bc9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:52.741730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c51bcee1-f0aa-4798-98de-2a7afe834bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:52.853604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 521/1034] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:53.152914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352826-927e-4752-a51c-50e6a4f6478b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:53.153195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352826-927e-4752-a51c-50e6a4f6478b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:53.153679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06352826-927e-4752-a51c-50e6a4f6478b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:53.155142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 514/1035] 10.222.0.26 () {54 vars in 961 bytes} [Wed Nov 2 07:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:53.165058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5757b4-3adc-42ac-add9-9937d9ca897c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:53.165961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5757b4-3adc-42ac-add9-9937d9ca897c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:53.166681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5757b4-3adc-42ac-add9-9937d9ca897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:53.198067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:53.268133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9d5757b4-3adc-42ac-add9-9937d9ca897c None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:53.269389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9d5757b4-3adc-42ac-add9-9937d9ca897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:53.390383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 522/1036] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Nov 2 07:35:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:53.398784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06352826-927e-4752-a51c-50e6a4f6478b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:53.401380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-06352826-927e-4752-a51c-50e6a4f6478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:53.552541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06352826-927e-4752-a51c-50e6a4f6478b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:53.627804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:53.668583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:53.669444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:53.669841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:53.670208 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:53.671869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:53.776840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:53.778617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53834f-38bb-43c8-a15d-adca159d79cd service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:53.799144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 515/1037] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:56.203146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337982f-e82d-40db-b23c-bea767157955 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:56.203146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337982f-e82d-40db-b23c-bea767157955 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:56.203146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337982f-e82d-40db-b23c-bea767157955 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:56.205237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 523/1038] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:56.210588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a4de-a00a-4186-bc26-73ac70661156 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:56.210588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a4de-a00a-4186-bc26-73ac70661156 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:56.210588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a4de-a00a-4186-bc26-73ac70661156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:56.278895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-86b7a4de-a00a-4186-bc26-73ac70661156 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:56.280018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-86b7a4de-a00a-4186-bc26-73ac70661156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:56.320679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:56.384756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 516/1039] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:56.676296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337982f-e82d-40db-b23c-bea767157955 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:56.677843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b337982f-e82d-40db-b23c-bea767157955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:56.746707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:56.847683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337982f-e82d-40db-b23c-bea767157955 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:56.985216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:56.986383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:56.986713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:56.997712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:56.997712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:57.013271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:57.083613 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:57.085198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af18905-7818-42c9-a644-fb8354858f36 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:57.103838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 524/1040] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:59.708467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0be6-d279-4f11-8bb3-6d46568f02cc None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:59.709048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0be6-d279-4f11-8bb3-6d46568f02cc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:59.709048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0be6-d279-4f11-8bb3-6d46568f02cc None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:59.710381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 517/1041] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:59.715912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4691a-d6b7-4c70-95d7-74da99fb12e6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:59.716334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4691a-d6b7-4c70-95d7-74da99fb12e6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:59.716528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4691a-d6b7-4c70-95d7-74da99fb12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:59.785805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-aab4691a-d6b7-4c70-95d7-74da99fb12e6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:59.787052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aab4691a-d6b7-4c70-95d7-74da99fb12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:59.889417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:59.897611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 525/1042] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:00.183583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e8cc-712a-4bd8-8f18-6257f5a43c81 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:00.183801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e8cc-712a-4bd8-8f18-6257f5a43c81 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:00.184271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e8cc-712a-4bd8-8f18-6257f5a43c81 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:00.185893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 518/1043] 10.222.0.26 () {54 vars in 961 bytes} [Wed Nov 2 07:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:00.191517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175e557-d8b6-4849-adf6-6bdbee26aa3d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:00.191805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175e557-d8b6-4849-adf6-6bdbee26aa3d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:00.192085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175e557-d8b6-4849-adf6-6bdbee26aa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:00.280499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6175e557-d8b6-4849-adf6-6bdbee26aa3d None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:00.281737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6175e557-d8b6-4849-adf6-6bdbee26aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:00.404655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 526/1044] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Nov 2 07:36:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:00.413071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149e8cc-712a-4bd8-8f18-6257f5a43c81 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:00.414676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1149e8cc-712a-4bd8-8f18-6257f5a43c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:00.570723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149e8cc-712a-4bd8-8f18-6257f5a43c81 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:00.593203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:00.699350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:00.699952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:00.700231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:00.701569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:00.707872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:00.759260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bc8c-62c0-4d66-9bfa-eeac32e3eebf None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:00.759784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bc8c-62c0-4d66-9bfa-eeac32e3eebf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:00.759784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bc8c-62c0-4d66-9bfa-eeac32e3eebf None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:00.761705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 527/1045] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:36:00.766051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736de1-2e22-4a29-85bc-4beffe1514ef None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:00.766448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736de1-2e22-4a29-85bc-4beffe1514ef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:00.767467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8736de1-2e22-4a29-85bc-4beffe1514ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:00.808271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:00.810473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53be3-a9a8-4f59-b002-94a3f208a2bb service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:00.831671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 519/1046] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:00.836421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:00.844281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8736de1-2e22-4a29-85bc-4beffe1514ef None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:00.845649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8736de1-2e22-4a29-85bc-4beffe1514ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:00.952255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 528/1047] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:36:01.298987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76d5ac-20b5-483c-b5f4-1ef2f377ed1c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:01.299295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76d5ac-20b5-483c-b5f4-1ef2f377ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:01.299642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76d5ac-20b5-483c-b5f4-1ef2f377ed1c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:01.301347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 520/1048] 10.222.0.26 () {54 vars in 963 bytes} [Wed Nov 2 07:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:01.306405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b30fce-646f-4855-b89a-2ced2874c20f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:01.306795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b30fce-646f-4855-b89a-2ced2874c20f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:01.307168 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b30fce-646f-4855-b89a-2ced2874c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:01.389623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e8b30fce-646f-4855-b89a-2ced2874c20f None None] MFA Rules not processed for user `4f95b0b156df4f26a498c8d332cc100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:01.390903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8b30fce-646f-4855-b89a-2ced2874c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:01.468349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:01.476536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 529/1049] 10.222.0.26 () {58 vars in 1060 bytes} [Wed Nov 2 07:36:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:01.484498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76d5ac-20b5-483c-b5f4-1ef2f377ed1c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:01.490737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5a76d5ac-20b5-483c-b5f4-1ef2f377ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:01.517175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:01.596308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76d5ac-20b5-483c-b5f4-1ef2f377ed1c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:01.674596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:01.675204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:01.675476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:01.675754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:01.677359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:01.760137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:01.798835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:01.800773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b621-d025-4cf3-b82c-59561c7ff859 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:01.829005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 521/1050] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:03.248445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c443-8d60-4b9c-a795-2e7227ba3179 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:03.249757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c443-8d60-4b9c-a795-2e7227ba3179 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:03.249757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86c443-8d60-4b9c-a795-2e7227ba3179 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:03.250664 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 530/1051] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:03.255883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a375bb-f7b8-4800-8472-be352b390d07 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:03.256292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a375bb-f7b8-4800-8472-be352b390d07 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:03.256414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a375bb-f7b8-4800-8472-be352b390d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:03.324088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-71a375bb-f7b8-4800-8472-be352b390d07 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:03.325288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-71a375bb-f7b8-4800-8472-be352b390d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:03.436324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 522/1052] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:03.723007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c443-8d60-4b9c-a795-2e7227ba3179 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:03.724809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c86c443-8d60-4b9c-a795-2e7227ba3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:03.879385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86c443-8d60-4b9c-a795-2e7227ba3179 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:03.951813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:04.002626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:04.003235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:04.003507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:04.003778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:04.005351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:04.098425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:04.100008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a082d-ce9d-43f2-b53d-63917d22d70c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:04.118395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 531/1053] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:06.432186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a354c5-ea1d-4e7f-82be-fa8ce2932dad None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:06.432739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a354c5-ea1d-4e7f-82be-fa8ce2932dad None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:06.432739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a354c5-ea1d-4e7f-82be-fa8ce2932dad None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:06.434259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 523/1054] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:06.439461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2266c-e67f-45c2-bd09-b93179da1c8f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:06.439874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2266c-e67f-45c2-bd09-b93179da1c8f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:06.440038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2266c-e67f-45c2-bd09-b93179da1c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:06.507947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b3f2266c-e67f-45c2-bd09-b93179da1c8f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:06.509042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b3f2266c-e67f-45c2-bd09-b93179da1c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:06.540770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:06.610530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 532/1055] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:06.898928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a354c5-ea1d-4e7f-82be-fa8ce2932dad None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:06.900470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d2a354c5-ea1d-4e7f-82be-fa8ce2932dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:06.942327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:07.059350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a354c5-ea1d-4e7f-82be-fa8ce2932dad None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:07.178999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:07.184303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:07.184899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:07.185178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:07.185454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:07.187210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:07.290810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:07.292527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2c0a-60f9-4c38-b83e-374a8f1d26d5 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:07.314313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 524/1056] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:09.621588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717e99-54ee-4652-9ecf-4da2e9bcfb70 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:09.622132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717e99-54ee-4652-9ecf-4da2e9bcfb70 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:09.622132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717e99-54ee-4652-9ecf-4da2e9bcfb70 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:09.623623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 533/1057] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:36:09.629352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11241b74-14aa-4fd6-a888-df3dfc4fdf63 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:09.629868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11241b74-14aa-4fd6-a888-df3dfc4fdf63 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:09.629977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11241b74-14aa-4fd6-a888-df3dfc4fdf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:09.695883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-11241b74-14aa-4fd6-a888-df3dfc4fdf63 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:09.697083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11241b74-14aa-4fd6-a888-df3dfc4fdf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:09.768582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:09.804965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 525/1058] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:10.122655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36717e99-54ee-4652-9ecf-4da2e9bcfb70 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:10.124404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-36717e99-54ee-4652-9ecf-4da2e9bcfb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:10.286974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36717e99-54ee-4652-9ecf-4da2e9bcfb70 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:10.302242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:10.413301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:10.413930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:10.414242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:10.414546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:10.416306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:10.520596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:10.522687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515ff1-4ced-4ce0-86cb-92fe1e3abf1b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:10.544670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 534/1059] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:12.853455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306f50-6dcb-455c-b1f5-0d76e5fe4a2d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:12.854101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306f50-6dcb-455c-b1f5-0d76e5fe4a2d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:12.854101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306f50-6dcb-455c-b1f5-0d76e5fe4a2d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:12.859920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 526/1060] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:12.860830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66094f3f-d4d1-47e0-bae0-aaef0c3419d9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:12.861261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66094f3f-d4d1-47e0-bae0-aaef0c3419d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:12.861447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66094f3f-d4d1-47e0-bae0-aaef0c3419d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:12.885158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:12.939434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-66094f3f-d4d1-47e0-bae0-aaef0c3419d9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:12.940944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-66094f3f-d4d1-47e0-bae0-aaef0c3419d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:13.055670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 535/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:36:13.344960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306f50-6dcb-455c-b1f5-0d76e5fe4a2d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:13.346693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73306f50-6dcb-455c-b1f5-0d76e5fe4a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:13.510935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306f50-6dcb-455c-b1f5-0d76e5fe4a2d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:13.567770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:13.632507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:13.633178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:13.633494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:13.633828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:13.635587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:13.734185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:13.736353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89426313-8410-4352-a993-aac9fb623df2 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:13.757719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 527/1062] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:15.936500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55899-2e54-4d24-be2d-dea9dd7460a5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:15.937077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55899-2e54-4d24-be2d-dea9dd7460a5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:15.937077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55899-2e54-4d24-be2d-dea9dd7460a5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:15.938952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 536/1063] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:15.944109 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c0550-3844-461f-9c43-3a17a1ab97e8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:15.944539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c0550-3844-461f-9c43-3a17a1ab97e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:15.944663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c0550-3844-461f-9c43-3a17a1ab97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:16.010209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-640c0550-3844-461f-9c43-3a17a1ab97e8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:16.011399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-640c0550-3844-461f-9c43-3a17a1ab97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:16.020018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:16.109202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 528/1064] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:16.396550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d55899-2e54-4d24-be2d-dea9dd7460a5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:16.398120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0d55899-2e54-4d24-be2d-dea9dd7460a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:16.487796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:16.541425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d55899-2e54-4d24-be2d-dea9dd7460a5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:16.652229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:16.652827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:16.653129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:16.653395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:16.654966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:16.713116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:16.742740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:16.744239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e5f5c-9da5-4e2b-bb2c-309cd797b5ea service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:16.761779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 537/1065] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:17.421780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529a139-a8b7-47be-ad56-0975cd12c23f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:17.422316 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529a139-a8b7-47be-ad56-0975cd12c23f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:17.422316 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529a139-a8b7-47be-ad56-0975cd12c23f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:17.423871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 529/1066] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:17.429069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed08c54-7c59-400e-bd3f-2012f87a6dbf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:17.429507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed08c54-7c59-400e-bd3f-2012f87a6dbf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:17.429706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed08c54-7c59-400e-bd3f-2012f87a6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:17.499252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fed08c54-7c59-400e-bd3f-2012f87a6dbf None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:17.500367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fed08c54-7c59-400e-bd3f-2012f87a6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:17.608500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 538/1067] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:17.910078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefbf56-9d4e-42a2-9a83-fca2b38ded09 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:17.910367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefbf56-9d4e-42a2-9a83-fca2b38ded09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:17.910645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefbf56-9d4e-42a2-9a83-fca2b38ded09 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:17.912011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 530/1068] 10.222.0.26 () {54 vars in 962 bytes} [Wed Nov 2 07:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:17.917343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c33a4-2275-42b3-97e0-a9be8bedec8f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:17.918291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c33a4-2275-42b3-97e0-a9be8bedec8f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:17.918574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c33a4-2275-42b3-97e0-a9be8bedec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:17.963924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:17.994629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b87c33a4-2275-42b3-97e0-a9be8bedec8f None None] MFA Rules not processed for user `0d3201a663964573be66ab4ad0d13b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:17.995853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b87c33a4-2275-42b3-97e0-a9be8bedec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:18.071105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 539/1069] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Nov 2 07:36:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:18.079946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefbf56-9d4e-42a2-9a83-fca2b38ded09 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:18.081450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-caefbf56-9d4e-42a2-9a83-fca2b38ded09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:18.184915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefbf56-9d4e-42a2-9a83-fca2b38ded09 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:18.222942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:18.262310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:18.262934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:18.263210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:18.263477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:18.265081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:18.374108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:18.375548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c0ee9-8ddb-4413-bf40-7a1780db9f32 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:18.394120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 531/1070] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:36:19.052524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78b42-1e82-43b0-b3f5-9f87cd6bfea0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.053081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78b42-1e82-43b0-b3f5-9f87cd6bfea0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.053081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78b42-1e82-43b0-b3f5-9f87cd6bfea0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.054504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 540/1071] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:19.060577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ef67-4dd4-4aa0-845a-a524b9e14752 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.061125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ef67-4dd4-4aa0-845a-a524b9e14752 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.061248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ef67-4dd4-4aa0-845a-a524b9e14752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.134790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5a89ef67-4dd4-4aa0-845a-a524b9e14752 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:19.136010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5a89ef67-4dd4-4aa0-845a-a524b9e14752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:19.154510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:19.234539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 532/1072] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:19.318233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.318522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.318794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.385892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:19.387091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:19.469283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:19.476747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 541/1073] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:19.526255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221f20-c1db-48fd-90cb-d003fb3cce88 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.526426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:19.526525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221f20-c1db-48fd-90cb-d003fb3cce88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.526793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221f20-c1db-48fd-90cb-d003fb3cce88 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.527590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:19.528170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 533/1074] 10.222.0.26 () {54 vars in 943 bytes} [Wed Nov 2 07:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:19.535198 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.535478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.535749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.612462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] MFA Rules not processed for user `c39f6ddafe58479a8dcf5161294a8b19`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:19.613696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:19.642868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fed67-984d-44a3-a3be-3aced9efb207 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:19.696501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:19.723703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 534/1075] 10.222.0.26 () {58 vars in 1040 bytes} [Wed Nov 2 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:36:19.732840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:19.743280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb24d06-341f-4969-a52a-01f48774b60e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:19.748388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:19.758748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:19.770521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.770521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.770521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.770521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:19.849273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:19.849900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:19.850181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:19.850453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:19.852076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:19.852361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:19.854026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76350-6002-4f19-92b8-777760489c16 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:19.872743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 542/1076] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:36:19.936006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:19.937603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2cf9-8ce7-4f9d-b75d-1d706fecc524 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:19.945636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 535/1077] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:36:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:36:22.242485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31875935-92d0-4c94-b448-d42706f063c5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:22.243235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31875935-92d0-4c94-b448-d42706f063c5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:22.243235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31875935-92d0-4c94-b448-d42706f063c5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:22.244462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 543/1078] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:22.249957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc77e9-a811-4b01-934c-bf098d84d17b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:22.250444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc77e9-a811-4b01-934c-bf098d84d17b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:22.250535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc77e9-a811-4b01-934c-bf098d84d17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:22.265035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:22.330996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0acc77e9-a811-4b01-934c-bf098d84d17b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:22.332198 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0acc77e9-a811-4b01-934c-bf098d84d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:22.441009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 536/1079] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:22.733580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31875935-92d0-4c94-b448-d42706f063c5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:22.735128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-31875935-92d0-4c94-b448-d42706f063c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:22.867663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:22.904663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31875935-92d0-4c94-b448-d42706f063c5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:23.035487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:23.036786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:23.037221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:23.037478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:23.039391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:23.152324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:23.174957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:23.176902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab9beb-b337-44cc-b0ff-e9a498b6b6cc service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:23.204860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 544/1080] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:26.291933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e846e-641c-4335-9dcf-c4c301a5138c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:26.292532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e846e-641c-4335-9dcf-c4c301a5138c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:26.292532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e846e-641c-4335-9dcf-c4c301a5138c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:26.293839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 537/1081] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:26.299092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4c4c-007f-474f-871a-dc602a757aa6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:26.299499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4c4c-007f-474f-871a-dc602a757aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:26.299676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd4c4c-007f-474f-871a-dc602a757aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:26.368679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7cfd4c4c-007f-474f-871a-dc602a757aa6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:26.369928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7cfd4c4c-007f-474f-871a-dc602a757aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:26.477396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 545/1082] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:36:26.770434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e846e-641c-4335-9dcf-c4c301a5138c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:26.771980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-901e846e-641c-4335-9dcf-c4c301a5138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:26.872634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:26.939900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e846e-641c-4335-9dcf-c4c301a5138c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:27.063565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:27.064310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:27.064665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:27.065004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:27.066697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:27.120816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:27.165577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:27.167298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2029-7a47-40dd-b9d4-f4ad500f360a service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:27.186796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 538/1083] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:29.608729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96882a-9182-499c-aa7e-3d7c1eeb6b2b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:29.609295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96882a-9182-499c-aa7e-3d7c1eeb6b2b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:29.609295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96882a-9182-499c-aa7e-3d7c1eeb6b2b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:29.610696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 546/1084] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:29.615949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9d1c6-04f8-436c-971b-2e75fda3ff6f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:29.616375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9d1c6-04f8-436c-971b-2e75fda3ff6f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:29.616566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9d1c6-04f8-436c-971b-2e75fda3ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:29.687262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8be9d1c6-04f8-436c-971b-2e75fda3ff6f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:29.689043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8be9d1c6-04f8-436c-971b-2e75fda3ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:29.813784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 539/1085] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:30.100740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96882a-9182-499c-aa7e-3d7c1eeb6b2b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:30.102284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef96882a-9182-499c-aa7e-3d7c1eeb6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:30.168349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:30.268168 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96882a-9182-499c-aa7e-3d7c1eeb6b2b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:30.393046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:30.393614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:30.394107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:30.394385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:30.395975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:30.413430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:30.490993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:30.492950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9e40-3174-4b80-b4ab-93c16c594c74 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:30.515474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 547/1086] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:36:39.800966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:40.510974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=38 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:44.500781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66b29f-2a1f-43a3-a87e-c7a0cc3906c7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:44.501229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66b29f-2a1f-43a3-a87e-c7a0cc3906c7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:44.501341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66b29f-2a1f-43a3-a87e-c7a0cc3906c7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:44.502706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 540/1087] 10.222.0.26 () {54 vars in 918 bytes} [Wed Nov 2 07:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:44.508574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a75f-9689-4896-bba9-e2b352d1bf99 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:44.511137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a75f-9689-4896-bba9-e2b352d1bf99 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:44.511137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a75f-9689-4896-bba9-e2b352d1bf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:44.584107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9048a75f-9689-4896-bba9-e2b352d1bf99 None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:44.585307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9048a75f-9689-4896-bba9-e2b352d1bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:44.691155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 548/1088] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Nov 2 07:36:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:44.705722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebe98-3152-4eba-b545-b7e6e36fae41 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:44.706008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebe98-3152-4eba-b545-b7e6e36fae41 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:44.706281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebe98-3152-4eba-b545-b7e6e36fae41 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:44.707593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 541/1089] 10.222.0.26 () {54 vars in 918 bytes} [Wed Nov 2 07:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:44.712334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a30f-a65b-48bb-a9a1-2400a26b988c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:44.712612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a30f-a65b-48bb-a9a1-2400a26b988c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:44.712883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4a30f-a65b-48bb-a9a1-2400a26b988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:44.785040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:44.787994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-42a4a30f-a65b-48bb-a9a1-2400a26b988c None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:44.789224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42a4a30f-a65b-48bb-a9a1-2400a26b988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:44.902252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 549/1090] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Nov 2 07:36:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:36:47.476359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208106-fac9-4ac2-83a5-e8c4eb77823a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:47.476888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208106-fac9-4ac2-83a5-e8c4eb77823a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:47.476888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82208106-fac9-4ac2-83a5-e8c4eb77823a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:47.478385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 542/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:47.483524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423a68-d073-43a1-9957-80cb179c5800 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:47.483920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423a68-d073-43a1-9957-80cb179c5800 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:47.484068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423a68-d073-43a1-9957-80cb179c5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:47.549698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0a423a68-d073-43a1-9957-80cb179c5800 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:47.550890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0a423a68-d073-43a1-9957-80cb179c5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:47.603651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:47.644660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 550/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:47.941053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82208106-fac9-4ac2-83a5-e8c4eb77823a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:47.942578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82208106-fac9-4ac2-83a5-e8c4eb77823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:48.086383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82208106-fac9-4ac2-83a5-e8c4eb77823a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:48.157021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:48.195407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:48.195997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:48.196274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:48.196540 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:48.198119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:48.286959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:48.288591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02829558-14bf-4ac9-9530-d34021dbddfa service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:48.306188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 543/1093] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:49.424086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79711745-ff5b-4b42-bb91-e570c2431ac3 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:49.424593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79711745-ff5b-4b42-bb91-e570c2431ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:49.424695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79711745-ff5b-4b42-bb91-e570c2431ac3 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:49.426015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 551/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:49.431028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58f2cf-5039-4782-851b-c78156c9d594 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:49.431482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58f2cf-5039-4782-851b-c78156c9d594 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:49.431581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58f2cf-5039-4782-851b-c78156c9d594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:49.511060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0d58f2cf-5039-4782-851b-c78156c9d594 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:49.512176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0d58f2cf-5039-4782-851b-c78156c9d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:49.538405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:49.604798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 544/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:36:49.767979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79711745-ff5b-4b42-bb91-e570c2431ac3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:49.769449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-79711745-ff5b-4b42-bb91-e570c2431ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:49.912447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79711745-ff5b-4b42-bb91-e570c2431ac3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:49.950796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:50.021801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:50.022337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:50.022613 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:50.022883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:50.024443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:50.111523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:50.113083 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512dea-786b-41d6-b59d-a9e325777ee9 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:50.130752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 552/1096] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:51.244885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319b16-aa28-4ba7-bb8b-a8a188bbebfb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:51.245311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319b16-aa28-4ba7-bb8b-a8a188bbebfb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:51.245428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319b16-aa28-4ba7-bb8b-a8a188bbebfb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:51.246812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 545/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:51.251920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc5809-a2a7-4613-a6a1-d550ce20c218 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:51.252308 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc5809-a2a7-4613-a6a1-d550ce20c218 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:51.252472 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc5809-a2a7-4613-a6a1-d550ce20c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:51.306093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:51.327025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0bcc5809-a2a7-4613-a6a1-d550ce20c218 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:51.328237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0bcc5809-a2a7-4613-a6a1-d550ce20c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:51.422654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 553/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:51.574592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319b16-aa28-4ba7-bb8b-a8a188bbebfb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:51.576126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e319b16-aa28-4ba7-bb8b-a8a188bbebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:51.718804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319b16-aa28-4ba7-bb8b-a8a188bbebfb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:51.731357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:51.830472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:51.830996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:51.831264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:51.831527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:51.833098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:51.921136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:51.922906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ecccd-6a12-40c6-b365-36c8c1c34574 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:51.941160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 546/1099] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:36:53.024157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3730f-d0db-464c-8f21-e827d1bfd575 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:53.024716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3730f-d0db-464c-8f21-e827d1bfd575 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:53.024716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3730f-d0db-464c-8f21-e827d1bfd575 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:53.026092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 554/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:53.030821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673f9c0-1084-4a39-a001-da28c73c9546 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:53.034737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673f9c0-1084-4a39-a001-da28c73c9546 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:53.034737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673f9c0-1084-4a39-a001-da28c73c9546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:53.051011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:53.106004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9673f9c0-1084-4a39-a001-da28c73c9546 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:53.107201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9673f9c0-1084-4a39-a001-da28c73c9546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:53.199645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 547/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:53.350632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3730f-d0db-464c-8f21-e827d1bfd575 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:53.352150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-78c3730f-d0db-464c-8f21-e827d1bfd575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:53.460524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:53.494836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3730f-d0db-464c-8f21-e827d1bfd575 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:53.604534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:53.605192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:53.605472 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:53.605771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:53.607342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:53.681983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:53.695274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:53.696838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57699e4a-d64c-45a3-8b59-f068962c634f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:53.714446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 555/1102] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:54.810529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931158-8524-4d1c-b13e-d26ec9c703e9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:54.811000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931158-8524-4d1c-b13e-d26ec9c703e9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:54.811121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931158-8524-4d1c-b13e-d26ec9c703e9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:54.812408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 548/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:54.817252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf81c5-c003-412e-93da-aae4e0c57744 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:54.817656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf81c5-c003-412e-93da-aae4e0c57744 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:54.817829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf81c5-c003-412e-93da-aae4e0c57744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:54.892124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ebcf81c5-c003-412e-93da-aae4e0c57744 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:54.893317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ebcf81c5-c003-412e-93da-aae4e0c57744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:54.987084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 556/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:55.137186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931158-8524-4d1c-b13e-d26ec9c703e9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:55.138698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4c931158-8524-4d1c-b13e-d26ec9c703e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:55.221409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:55.284235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931158-8524-4d1c-b13e-d26ec9c703e9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:55.394379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:55.394903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:55.395178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:55.395444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:55.397003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:55.443728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:55.484845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:55.486529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c7e31-d774-42ad-8e78-563ed501089d service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:55.505201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 549/1105] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:56.601468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9e92-ff6f-4e4b-b996-22e82df3424b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:56.602055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9e92-ff6f-4e4b-b996-22e82df3424b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:56.602055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9e92-ff6f-4e4b-b996-22e82df3424b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:56.603395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 557/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:56.608106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e3d8-c40c-463f-9c96-cb0814960924 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:56.608501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e3d8-c40c-463f-9c96-cb0814960924 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:56.608668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e3d8-c40c-463f-9c96-cb0814960924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:56.684061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-01c1e3d8-c40c-463f-9c96-cb0814960924 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:56.685238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-01c1e3d8-c40c-463f-9c96-cb0814960924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:56.780010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 550/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:56.931252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9e92-ff6f-4e4b-b996-22e82df3424b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:56.932674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-983e9e92-ff6f-4e4b-b996-22e82df3424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:56.982287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:57.076022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9e92-ff6f-4e4b-b996-22e82df3424b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:57.184984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:57.185506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:57.185811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:57.186082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:57.187656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:57.194383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:57.278313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:57.279894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffa861-8b71-484e-a753-7a3d3c00fb1c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:57.298503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 558/1108] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:36:58.402077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14322f-cd29-4b7b-a788-dbacde0da0c2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:58.402569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14322f-cd29-4b7b-a788-dbacde0da0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:58.402681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14322f-cd29-4b7b-a788-dbacde0da0c2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:58.403969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 551/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:36:58.408903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cfa28-3528-4add-ae63-963a086f7801 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:58.409342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cfa28-3528-4add-ae63-963a086f7801 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:58.409452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cfa28-3528-4add-ae63-963a086f7801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:58.483022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-aa2cfa28-3528-4add-ae63-963a086f7801 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:58.484122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aa2cfa28-3528-4add-ae63-963a086f7801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:58.550980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:58.580086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 559/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:58.730834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14322f-cd29-4b7b-a788-dbacde0da0c2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:58.732328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3b14322f-cd29-4b7b-a788-dbacde0da0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:58.750304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:58.876253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14322f-cd29-4b7b-a788-dbacde0da0c2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:58.962494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:58.987438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:58.988041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:58.988319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:58.988591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:58.990190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:59.080283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:59.081800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e049a-23fa-4f60-b931-79ba122a7ec5 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:59.099440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 552/1111] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:00.204013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634727e7-dcf6-4a18-b354-d9bc46c89621 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:00.204576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634727e7-dcf6-4a18-b354-d9bc46c89621 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:00.204576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634727e7-dcf6-4a18-b354-d9bc46c89621 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:00.205959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 560/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:37:00.210872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986420a2-9dbd-43db-aeae-4f40aeaf4624 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:00.211281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986420a2-9dbd-43db-aeae-4f40aeaf4624 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:00.211415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986420a2-9dbd-43db-aeae-4f40aeaf4624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:00.285459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-986420a2-9dbd-43db-aeae-4f40aeaf4624 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:00.286685 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-986420a2-9dbd-43db-aeae-4f40aeaf4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:00.326576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:00.381137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 553/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:00.529302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634727e7-dcf6-4a18-b354-d9bc46c89621 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:00.530758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-634727e7-dcf6-4a18-b354-d9bc46c89621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:00.671357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634727e7-dcf6-4a18-b354-d9bc46c89621 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:00.727778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:00.783838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:00.784388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:00.784666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:00.784939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:00.786573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:00.876341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:00.877963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8d63-6424-4788-a706-5895626a1cdf service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:00.895482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 561/1114] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:01.986102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fe46-7bf8-448d-9472-0d51301f8527 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:01.986639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fe46-7bf8-448d-9472-0d51301f8527 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:01.986639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fe46-7bf8-448d-9472-0d51301f8527 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:01.988019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 554/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:01.992808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8847-935f-4df8-bc75-fdb96b2a6ade None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:01.993222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8847-935f-4df8-bc75-fdb96b2a6ade None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:01.993354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce8847-935f-4df8-bc75-fdb96b2a6ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:02.068236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-06ce8847-935f-4df8-bc75-fdb96b2a6ade None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:02.069426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-06ce8847-935f-4df8-bc75-fdb96b2a6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:02.071434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:02.165263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 562/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:02.315413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3fe46-7bf8-448d-9472-0d51301f8527 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:02.316972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2dc3fe46-7bf8-448d-9472-0d51301f8527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:02.459003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3fe46-7bf8-448d-9472-0d51301f8527 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:02.485586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:02.568858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:02.569373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:02.569676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:02.569947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:02.571506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:02.659316 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:02.660886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da063e83-8eb8-48fd-b156-adbad84f7836 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:02.678575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 555/1117] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:04.737619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec496a-9a20-4145-b3ed-e002eca7a340 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:04.737619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec496a-9a20-4145-b3ed-e002eca7a340 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:04.737619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec496a-9a20-4145-b3ed-e002eca7a340 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:04.737619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 563/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:04.740847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1bc3-662f-4071-bd4b-72bcabbb5e58 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:04.741234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1bc3-662f-4071-bd4b-72bcabbb5e58 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:04.741417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1bc3-662f-4071-bd4b-72bcabbb5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:04.782150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:04.806629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cdfd1bc3-662f-4071-bd4b-72bcabbb5e58 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:04.807833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cdfd1bc3-662f-4071-bd4b-72bcabbb5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:04.903002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 556/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:05.186997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec496a-9a20-4145-b3ed-e002eca7a340 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:05.189145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9aec496a-9a20-4145-b3ed-e002eca7a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:05.292862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec496a-9a20-4145-b3ed-e002eca7a340 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:05.325397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:05.366225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:05.366821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:05.367090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:05.367354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:05.368900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:05.474468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:05.475813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150394be-1175-4fb9-83b5-9c28d1f9ca1a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:05.493992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 564/1120] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:07.771570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c23d9-2bd4-490d-9a6a-a970a36e0181 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:07.772156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c23d9-2bd4-490d-9a6a-a970a36e0181 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:07.772156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c23d9-2bd4-490d-9a6a-a970a36e0181 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:07.773436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 557/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:07.778684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b1a98-65c0-43ee-beeb-8a351cae130e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:07.779083 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b1a98-65c0-43ee-beeb-8a351cae130e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:07.779229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b1a98-65c0-43ee-beeb-8a351cae130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:07.845690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6b7b1a98-65c0-43ee-beeb-8a351cae130e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:07.846874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b7b1a98-65c0-43ee-beeb-8a351cae130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:07.859782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:07.942704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 565/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:08.225781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c23d9-2bd4-490d-9a6a-a970a36e0181 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:08.227303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-941c23d9-2bd4-490d-9a6a-a970a36e0181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:08.328902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c23d9-2bd4-490d-9a6a-a970a36e0181 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:08.341402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:08.402088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:08.402683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:08.402958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:08.403226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:08.404783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:08.512212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:08.513575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb667a-04ea-4b50-8e91-2e8c7c8e53a8 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:08.532225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 558/1123] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:11.025510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60c903-80e4-4f78-a65b-338c3bdc956a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:11.026091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60c903-80e4-4f78-a65b-338c3bdc956a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:11.026091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60c903-80e4-4f78-a65b-338c3bdc956a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:11.027458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 566/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:11.032818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbf8b6-23b0-4356-a5d7-548b9122e6b9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:11.033259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbf8b6-23b0-4356-a5d7-548b9122e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:11.033351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbf8b6-23b0-4356-a5d7-548b9122e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:11.080739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:11.098089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7dcbf8b6-23b0-4356-a5d7-548b9122e6b9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:11.099342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7dcbf8b6-23b0-4356-a5d7-548b9122e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:11.193338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 559/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:11.472601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60c903-80e4-4f78-a65b-338c3bdc956a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:11.474191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3b60c903-80e4-4f78-a65b-338c3bdc956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:11.576804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60c903-80e4-4f78-a65b-338c3bdc956a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:11.616416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:11.648899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:11.649494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:11.649807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:11.650080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:11.651645 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:11.756019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:11.757344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f627c-e396-4f65-8f6a-7ecba0aafce3 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:11.775696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 567/1126] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:14.049730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e932d8-7373-4901-80f0-117c3ae0e9fe None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:14.050296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e932d8-7373-4901-80f0-117c3ae0e9fe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:14.050296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e932d8-7373-4901-80f0-117c3ae0e9fe None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:14.051785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 560/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:14.057091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc052cc-207c-4346-8962-8eb4a01d89d6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:14.057512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc052cc-207c-4346-8962-8eb4a01d89d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:14.057686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc052cc-207c-4346-8962-8eb4a01d89d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:14.122760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3fc052cc-207c-4346-8962-8eb4a01d89d6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:14.123962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fc052cc-207c-4346-8962-8eb4a01d89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:14.144702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:14.218575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 568/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:14.505174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e932d8-7373-4901-80f0-117c3ae0e9fe None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:14.506754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b9e932d8-7373-4901-80f0-117c3ae0e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:14.609977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e932d8-7373-4901-80f0-117c3ae0e9fe None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:14.629878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:14.682534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:14.683135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:14.683413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:14.683684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:14.685295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:14.792165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:14.793598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bd3d-248f-433d-b6f9-21aa0d9a97d9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:14.810913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 561/1129] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:17.102207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3bb5d-8b9f-4aa4-b665-212117f58b3e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.102773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3bb5d-8b9f-4aa4-b665-212117f58b3e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.102773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3bb5d-8b9f-4aa4-b665-212117f58b3e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.104130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 569/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:17.109297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b2d1c-a8ed-4952-a665-0cbe736aff49 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.109763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b2d1c-a8ed-4952-a665-0cbe736aff49 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.109877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b2d1c-a8ed-4952-a665-0cbe736aff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.173322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:17.176091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ff4b2d1c-a8ed-4952-a665-0cbe736aff49 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:17.177347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ff4b2d1c-a8ed-4952-a665-0cbe736aff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.272909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 562/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:17.553303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3bb5d-8b9f-4aa4-b665-212117f58b3e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:17.554849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dca3bb5d-8b9f-4aa4-b665-212117f58b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.656955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3bb5d-8b9f-4aa4-b665-212117f58b3e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:17.706192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:17.728897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:17.729493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.729791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.730059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.731622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.837877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:17.839301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181853bc-ce74-4815-8ec7-3144378d7cd4 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:17.856653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 570/1132] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:20.070639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c97a-1020-4a81-a1c7-e3573309c439 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.071206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c97a-1020-4a81-a1c7-e3573309c439 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.071206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c97a-1020-4a81-a1c7-e3573309c439 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.072531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 563/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:20.078409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1206d5-1d86-4e9e-ae3d-08f4e5a67820 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.078838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1206d5-1d86-4e9e-ae3d-08f4e5a67820 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.078958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1206d5-1d86-4e9e-ae3d-08f4e5a67820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.144217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8d1206d5-1d86-4e9e-ae3d-08f4e5a67820 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:20.145395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8d1206d5-1d86-4e9e-ae3d-08f4e5a67820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:20.174070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:20.240707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 571/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:20.523838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c97a-1020-4a81-a1c7-e3573309c439 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.525409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5d16c97a-1020-4a81-a1c7-e3573309c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:20.626555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c97a-1020-4a81-a1c7-e3573309c439 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.653534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:20.696631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.697222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.697503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.697791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.699345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:20.804511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.805955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ed09c-37a2-4a36-a1f6-0da56496e47d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.824178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 564/1135] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:23.021069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cfb56-f3b6-4fa2-855e-06eb27b65bad None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.021626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cfb56-f3b6-4fa2-855e-06eb27b65bad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.021626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cfb56-f3b6-4fa2-855e-06eb27b65bad None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.023002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 572/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:23.028386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b84c-8353-4a3c-a08e-54ff76456d91 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.034786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b84c-8353-4a3c-a08e-54ff76456d91 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.034786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b84c-8353-4a3c-a08e-54ff76456d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.095911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5f61b84c-8353-4a3c-a08e-54ff76456d91 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:23.097098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f61b84c-8353-4a3c-a08e-54ff76456d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.105092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:23.192264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 565/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:23.475723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cfb56-f3b6-4fa2-855e-06eb27b65bad None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:23.477228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ee6cfb56-f3b6-4fa2-855e-06eb27b65bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.578603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cfb56-f3b6-4fa2-855e-06eb27b65bad None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:23.633069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:23.650904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:23.651497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:23.651769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:23.652034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:23.653598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:23.760015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:23.761323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dd0db-d9b6-45b2-b86a-05448b537197 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:23.779141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 573/1138] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:25.969989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa848c-fdcf-4e4b-8163-add20fdcf1fa None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:25.970525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa848c-fdcf-4e4b-8163-add20fdcf1fa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:25.970525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa848c-fdcf-4e4b-8163-add20fdcf1fa None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:25.971880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:25.977285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf208-53c8-4d6a-b5d4-6895340c9680 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:25.977752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf208-53c8-4d6a-b5d4-6895340c9680 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:25.977877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf208-53c8-4d6a-b5d4-6895340c9680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:26.042548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a71cf208-53c8-4d6a-b5d4-6895340c9680 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:26.043752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a71cf208-53c8-4d6a-b5d4-6895340c9680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:26.081501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:26.138234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:26.423731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa848c-fdcf-4e4b-8163-add20fdcf1fa None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:26.425248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e0fa848c-fdcf-4e4b-8163-add20fdcf1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:26.527622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa848c-fdcf-4e4b-8163-add20fdcf1fa None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:26.564764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:26.600434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:26.601032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:26.601310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:26.601610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:26.603189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:26.711305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:26.712724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb8ab-acd5-459e-98b0-7493b307c257 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:26.730745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 567/1141] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:28.899136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c58a-f685-4f09-80e9-99bf1ebe98ba None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.899674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c58a-f685-4f09-80e9-99bf1ebe98ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.899793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c58a-f685-4f09-80e9-99bf1ebe98ba None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.901090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:28.907177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a7dd-3b3f-40d1-a6ec-7ce53d95b179 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.910140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a7dd-3b3f-40d1-a6ec-7ce53d95b179 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.910140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a7dd-3b3f-40d1-a6ec-7ce53d95b179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.973359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5bf3a7dd-3b3f-40d1-a6ec-7ce53d95b179 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:28.974596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5bf3a7dd-3b3f-40d1-a6ec-7ce53d95b179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:28.992259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:29.069673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:29.354079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c58a-f685-4f09-80e9-99bf1ebe98ba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:29.355596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f988c58a-f685-4f09-80e9-99bf1ebe98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:29.458496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c58a-f685-4f09-80e9-99bf1ebe98ba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:29.522452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:29.528731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:29.529325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.529626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.529896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:29.531430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:29.638218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:29.639704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae888ace-4481-4167-a491-9e1febbb7902 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:29.656862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 576/1144] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:31.800634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb50ce-aa5e-4a04-ad6e-170608bbda43 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.801092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb50ce-aa5e-4a04-ad6e-170608bbda43 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.801213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb50ce-aa5e-4a04-ad6e-170608bbda43 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.802546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:31.807878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6803-7bf8-4594-b615-5b1fe0fecfad None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.808294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6803-7bf8-4594-b615-5b1fe0fecfad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.808436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6803-7bf8-4594-b615-5b1fe0fecfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.874821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-497e6803-7bf8-4594-b615-5b1fe0fecfad None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:31.876050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-497e6803-7bf8-4594-b615-5b1fe0fecfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:31.922790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:31.970081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:32.256754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb50ce-aa5e-4a04-ad6e-170608bbda43 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:32.258338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-53bb50ce-aa5e-4a04-ad6e-170608bbda43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:32.360630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb50ce-aa5e-4a04-ad6e-170608bbda43 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:32.407784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:32.432752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:32.433355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:32.433871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:32.434447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:32.436100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:32.541721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:32.543066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb814235-fc47-403d-9e54-30fe8ddf4907 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:32.561583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 570/1147] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:41.970952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=22 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:42.559391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=66 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:52.409406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408c2a-6045-43d6-a251-f7a97b1702e4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:52.409900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408c2a-6045-43d6-a251-f7a97b1702e4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:52.410021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408c2a-6045-43d6-a251-f7a97b1702e4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:52.411347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 578/1148] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:52.416873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325abb6-a869-4202-adf2-c1b960b9a701 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:52.417279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325abb6-a869-4202-adf2-c1b960b9a701 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:52.417421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325abb6-a869-4202-adf2-c1b960b9a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:52.483161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0325abb6-a869-4202-adf2-c1b960b9a701 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:52.484272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0325abb6-a869-4202-adf2-c1b960b9a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:52.577511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 571/1149] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:52.875980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959d4dd-ea2b-416d-8a12-65ad3c824e38 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:52.876265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959d4dd-ea2b-416d-8a12-65ad3c824e38 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:52.876536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959d4dd-ea2b-416d-8a12-65ad3c824e38 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:52.877926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 579/1150] 10.222.0.26 () {54 vars in 962 bytes} [Wed Nov 2 07:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:52.882842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42ad9-1542-4431-9531-93cf3f8ce09f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:52.883131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42ad9-1542-4431-9531-93cf3f8ce09f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:52.883433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42ad9-1542-4431-9531-93cf3f8ce09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:52.959023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d3c42ad9-1542-4431-9531-93cf3f8ce09f None None] MFA Rules not processed for user `0d3201a663964573be66ab4ad0d13b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:52.960229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d3c42ad9-1542-4431-9531-93cf3f8ce09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:52.980906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:53.035592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 572/1151] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Nov 2 07:37:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:53.043531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959d4dd-ea2b-416d-8a12-65ad3c824e38 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:53.045027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4959d4dd-ea2b-416d-8a12-65ad3c824e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:53.145630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959d4dd-ea2b-416d-8a12-65ad3c824e38 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:53.220564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:53.221196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:53.221492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:53.221888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:53.223437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:53.278262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:53.331882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:53.333314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2cdb8-22bd-4c11-87c1-c9bfd515a2fa service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:53.351197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 580/1152] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:37:55.586860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f06dc-8c63-4083-995c-6af0dd5d658e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:55.587395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f06dc-8c63-4083-995c-6af0dd5d658e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:55.587395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f06dc-8c63-4083-995c-6af0dd5d658e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:55.588749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 573/1153] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:55.594485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dee89-f731-43d0-8b57-5f2c4184a857 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:55.594914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dee89-f731-43d0-8b57-5f2c4184a857 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:55.595021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dee89-f731-43d0-8b57-5f2c4184a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:55.659206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-064dee89-f731-43d0-8b57-5f2c4184a857 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:55.660395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-064dee89-f731-43d0-8b57-5f2c4184a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:55.755206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 581/1154] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:56.039842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f06dc-8c63-4083-995c-6af0dd5d658e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:56.039842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-000f06dc-8c63-4083-995c-6af0dd5d658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:56.158598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f06dc-8c63-4083-995c-6af0dd5d658e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:56.207451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:56.252887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:56.253492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:56.253803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:56.254079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:56.254717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:56.255737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:56.255737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:37:56.255737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:37:56.256866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95490e-1149-4fa8-b2a7-8e6b97b15dab admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:56.276155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 574/1155] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Nov 2 07:37:56 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:58.433021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1fe93-2c5d-4ebb-8182-778233745316 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:58.433498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1fe93-2c5d-4ebb-8182-778233745316 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:58.433666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1fe93-2c5d-4ebb-8182-778233745316 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:58.434930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 582/1156] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:58.440066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d8f4-7e3d-4f6d-83ba-73b142fbf35a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:58.440502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d8f4-7e3d-4f6d-83ba-73b142fbf35a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:58.440645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d8f4-7e3d-4f6d-83ba-73b142fbf35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:58.507250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-93e2d8f4-7e3d-4f6d-83ba-73b142fbf35a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:58.508483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-93e2d8f4-7e3d-4f6d-83ba-73b142fbf35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:58.602787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 575/1157] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:58.894408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1fe93-2c5d-4ebb-8182-778233745316 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:58.895934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2d1fe93-2c5d-4ebb-8182-778233745316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:58.905855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:59.040399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1fe93-2c5d-4ebb-8182-778233745316 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:59.119129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:59.152138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:59.152701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:59.152977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:59.153243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:59.154841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:59.245379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:59.251159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82791a2e-de36-4c57-bda4-29c21be73c7c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:59.264409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 583/1158] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:38:01.578121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62801-55e1-4cda-9c80-0ac9fb09bc00 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:01.578668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62801-55e1-4cda-9c80-0ac9fb09bc00 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:01.578668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62801-55e1-4cda-9c80-0ac9fb09bc00 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:01.579965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 576/1159] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:38:01.585399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3d91-668a-4e07-a3e4-9e4dded10797 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:01.585851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3d91-668a-4e07-a3e4-9e4dded10797 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:01.585974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3d91-668a-4e07-a3e4-9e4dded10797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:01.649990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f50f3d91-668a-4e07-a3e4-9e4dded10797 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:01.651167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f50f3d91-668a-4e07-a3e4-9e4dded10797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:01.696125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:01.745312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 584/1160] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:38:02.033233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62801-55e1-4cda-9c80-0ac9fb09bc00 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:38:02.034822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-52a62801-55e1-4cda-9c80-0ac9fb09bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:02.058399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:02.135175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62801-55e1-4cda-9c80-0ac9fb09bc00 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:38:02.206696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:38:02.207293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:02.207566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:02.207833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:02.209402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:02.283761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:02.318511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:38:02.319932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aebe27-c6c2-4886-8e78-a43bad9a549b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:38:02.338511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 577/1161] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:38:04.512429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b779e6-ed7f-4eb0-abe4-435a72a3b096 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:04.512938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b779e6-ed7f-4eb0-abe4-435a72a3b096 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:04.512938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b779e6-ed7f-4eb0-abe4-435a72a3b096 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:04.514324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 585/1162] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:38:04.519833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02efa73-d729-4fcf-85ce-fb8a5aefbb03 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:04.520249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02efa73-d729-4fcf-85ce-fb8a5aefbb03 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:04.520385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02efa73-d729-4fcf-85ce-fb8a5aefbb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:04.585992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c02efa73-d729-4fcf-85ce-fb8a5aefbb03 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:04.587178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c02efa73-d729-4fcf-85ce-fb8a5aefbb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:04.683079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 578/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:38:04.972223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b779e6-ed7f-4eb0-abe4-435a72a3b096 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:38:04.973747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b0b779e6-ed7f-4eb0-abe4-435a72a3b096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:05.075066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b779e6-ed7f-4eb0-abe4-435a72a3b096 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:38:05.146481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:05.147949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:38:05.148547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:05.148823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:05.149092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:05.150684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:05.259936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:38:05.261360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410fe10-89b4-487b-a3f0-a1a170918c68 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:38:05.279373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 586/1164] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:38:07.507381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5819e-dea2-46ff-a5bf-ac77ea936cd6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:07.507934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5819e-dea2-46ff-a5bf-ac77ea936cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:07.507934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5819e-dea2-46ff-a5bf-ac77ea936cd6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:07.509180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 579/1165] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:38:07.514424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930cdf6-e2ed-4d58-8d7d-398a683eb017 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:07.514852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930cdf6-e2ed-4d58-8d7d-398a683eb017 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:07.514975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930cdf6-e2ed-4d58-8d7d-398a683eb017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:07.579298 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f930cdf6-e2ed-4d58-8d7d-398a683eb017 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:07.580484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f930cdf6-e2ed-4d58-8d7d-398a683eb017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:07.632108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:07.674987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 587/1166] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:38:07.969705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5819e-dea2-46ff-a5bf-ac77ea936cd6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:38:07.971219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2fc5819e-dea2-46ff-a5bf-ac77ea936cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:08.006333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:08.073052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5819e-dea2-46ff-a5bf-ac77ea936cd6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:38:08.144660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:38:08.145255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:08.145532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:08.145827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:08.147390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:08.224998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:08.254451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:38:08.255890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ace361-c1ae-4c3a-a479-191a573138e6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:38:08.274858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 580/1167] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:38:10.727929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99e4fb-8e74-48e4-9d54-4d139eb3dafb None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:10.728494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99e4fb-8e74-48e4-9d54-4d139eb3dafb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:10.728494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99e4fb-8e74-48e4-9d54-4d139eb3dafb None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:10.729909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 588/1168] 10.222.0.26 () {54 vars in 927 bytes} [Wed Nov 2 07:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:38:10.735794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690027a3-0ed5-4945-8c11-b47948f6d5fb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:10.736228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690027a3-0ed5-4945-8c11-b47948f6d5fb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:10.736342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690027a3-0ed5-4945-8c11-b47948f6d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:10.803315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-690027a3-0ed5-4945-8c11-b47948f6d5fb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:10.804493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-690027a3-0ed5-4945-8c11-b47948f6d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:10.899186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 581/1169] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Nov 2 07:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:38:11.188090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99e4fb-8e74-48e4-9d54-4d139eb3dafb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:38:11.189642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a99e4fb-8e74-48e4-9d54-4d139eb3dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:11.294165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99e4fb-8e74-48e4-9d54-4d139eb3dafb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:38:11.367077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:38:11.367673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:11.367949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:11.368218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:11.370170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:11.379113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:11.476191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:38:11.477565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d88e3-25d0-4cd5-8266-99a177333772 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:38:11.496299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 589/1170] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:38:20.897727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=82 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:21.493354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=50 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:31.805452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:31.806067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:31.806067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:31.879359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:31.880544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:31.974429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 582/1171] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:31.982241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:31.982715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:31.982816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:32.055693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:32.056796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:32.150820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 590/1172] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:32.155322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:32.156529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:32.167745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8d2a8-f17a-49e6-bbf7-3c7703b430bf None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:32.231658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:32.265588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:32.266190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:32.266462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:32.266729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:32.267356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:39:32.267651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:32.268647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:39:32.268647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:39:32.268647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:39:32.269517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:32.280313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 583/1173] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:39:32.289899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:32.299062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2820-4820-47bb-bfbf-d8874439fb20 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:32.358912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:32.392807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:32.393406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:32.393712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:32.393981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:32.394630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:32.395718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:39:32.395718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:39:32.395718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:39:32.396889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:32.510108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 591/1174] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:39:32 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:39:32.514344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:32.515865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:32.548953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f7150-1058-4aae-b603-fba73d748c8c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:32.641978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:32.642523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:32.642793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:32.643057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:32.643666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:32.644653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:39:32.644653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:39:32.644653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:39:32.645864 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:32.743425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 584/1175] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:39:32 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:39:32.747565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:32.749076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:32.808815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e890616-54a2-495b-ae16-01e9193fe853 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:32.889561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:32.899356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:32.899890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:32.900164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:32.900433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:32.901068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:32.902666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:32.915738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 592/1176] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:39:32.927823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:32.927823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:32.933315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5745-aeea-4442-8187-a4a07ea579fb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:32.957718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:33.025328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fa939-bc44-4f1d-bf8b-c2ad6adcc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:33.025969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa939-bc44-4f1d-bf8b-c2ad6adcc048 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.026247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa939-bc44-4f1d-bf8b-c2ad6adcc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.026515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fa939-bc44-4f1d-bf8b-c2ad6adcc048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.027150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa939-bc44-4f1d-bf8b-c2ad6adcc048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:33.028756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fa939-bc44-4f1d-bf8b-c2ad6adcc048 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:33.041779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 585/1177] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:39:33.046116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:33.047651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:33.080314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e8c1-78b6-4f81-b20f-6223523d8057 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:33.177892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883168cb-1320-42b4-90bf-ed9289bb8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:33.177892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883168cb-1320-42b4-90bf-ed9289bb8f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.177892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883168cb-1320-42b4-90bf-ed9289bb8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.177892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883168cb-1320-42b4-90bf-ed9289bb8f9a admin admin] PATH_INFO: `/v3/projects/6411edf9e9604a4ea2425dc9c16e6fe6/users/7d5234d3e78a4f8fb824046070719103/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.196521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883168cb-1320-42b4-90bf-ed9289bb8f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6411edf9e9604a4ea2425dc9c16e6fe6, user_id=7d5234d3e78a4f8fb824046070719103, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:33.199241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883168cb-1320-42b4-90bf-ed9289bb8f9a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:33.307793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 593/1178] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:39:33 2022] PUT /identity/v3/projects/6411edf9e9604a4ea2425dc9c16e6fe6/users/7d5234d3e78a4f8fb824046070719103/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:39:33.318741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb475-c1cf-4e88-b00f-96375ed49b24 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.327231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb475-c1cf-4e88-b00f-96375ed49b24 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.327231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb475-c1cf-4e88-b00f-96375ed49b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.374506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-266cb475-c1cf-4e88-b00f-96375ed49b24 None None] MFA Rules not processed for user `7d5234d3e78a4f8fb824046070719103`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:33.375687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-266cb475-c1cf-4e88-b00f-96375ed49b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:33.451924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 586/1179] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:39:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:33.465498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085061e-c935-4ec6-8933-241102038fc1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.465822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085061e-c935-4ec6-8933-241102038fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.466099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085061e-c935-4ec6-8933-241102038fc1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.467424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 594/1180] 10.222.0.26 () {54 vars in 963 bytes} [Wed Nov 2 07:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:33.472193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ad66-ec94-4c6b-8845-25568db6b03f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.472483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ad66-ec94-4c6b-8845-25568db6b03f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.472763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ad66-ec94-4c6b-8845-25568db6b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.503661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:33.548046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8813ad66-ec94-4c6b-8845-25568db6b03f None None] MFA Rules not processed for user `4f95b0b156df4f26a498c8d332cc100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:33.549240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8813ad66-ec94-4c6b-8845-25568db6b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:33.622683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 587/1181] 10.222.0.26 () {58 vars in 1060 bytes} [Wed Nov 2 07:39:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:33.630497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085061e-c935-4ec6-8933-241102038fc1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:33.631982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b085061e-c935-4ec6-8933-241102038fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:33.681967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:33.734559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085061e-c935-4ec6-8933-241102038fc1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:33.808375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:33.808970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.809245 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.809513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.811099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:33.907199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:33.908605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:33.912072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:33.925933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 595/1182] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:39:33.971009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6a459-094e-46b2-950b-3ed2d90f1cc8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:33.971417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6a459-094e-46b2-950b-3ed2d90f1cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:33.971556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6a459-094e-46b2-950b-3ed2d90f1cc8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:33.972831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 588/1183] 10.222.0.26 () {52 vars in 830 bytes} [Wed Nov 2 07:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:33.976463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:33.977681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:34.074980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc9ae-dda5-4456-8d90-65b102567abf service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:34.204762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:34.205386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:34.205764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:34.206038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] PATH_INFO: `/v3/users/7d5234d3e78a4f8fb824046070719103` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:34.218492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5234d3e78a4f8fb824046070719103)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:34.219555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:39:34.219555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:39:34.219555 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:39:34.220796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:34.234113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:34.442325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5234d3e78a4f8fb824046070719103'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:34.442769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5234d3e78a4f8fb824046070719103'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:34.465987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5234d3e78a4f8fb824046070719103'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:34.558325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5234d3e78a4f8fb824046070719103'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:34.572903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5234d3e78a4f8fb824046070719103'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:34.578594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 596/1184] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:39:33 2022] DELETE /identity/v3/users/7d5234d3e78a4f8fb824046070719103 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:39:34.582952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:34.583236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:34.583510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:34.642220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:34.643469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:34.718591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:34.730747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 589/1185] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:34.740696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:34.742028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:34.841070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316cc0a-dac1-4445-9f82-b1933714708d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:34.894305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:34.913348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:34.914078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:34.914359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:34.914631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:34.916237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:35.022640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:35.024563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc1111-0e2f-4d0d-913a-69ce29b2084e service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:35.042473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 597/1186] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:35.503295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:35.506367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:35.516662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7420c16-1639-4cd7-a606-76421d4f9416 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:35.613654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:35.614275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:35.614826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:35.615091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] PATH_INFO: `/v3/projects/6411edf9e9604a4ea2425dc9c16e6fe6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:35.625314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6411edf9e9604a4ea2425dc9c16e6fe6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:35.626374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:39:35.626374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:39:35.626374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:39:35.627557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:35.738450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6411edf9e9604a4ea2425dc9c16e6fe6', 'request_id': 'req-c1d664dc-234d-48e7-b363-fe184e27a2f0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:35.754210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6411edf9e9604a4ea2425dc9c16e6fe6', 'request_id': 'req-c1d664dc-234d-48e7-b363-fe184e27a2f0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:35.855891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6411edf9e9604a4ea2425dc9c16e6fe6', 'request_id': 'req-c1d664dc-234d-48e7-b363-fe184e27a2f0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:35.880148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] The token cache is being invalidate because project 6411edf9e9604a4ea2425dc9c16e6fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:39:35.880439 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:35.880966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1d664dc-234d-48e7-b363-fe184e27a2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:39:35.882426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 590/1187] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:39:35 2022] DELETE /identity/v3/projects/6411edf9e9604a4ea2425dc9c16e6fe6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:39:45.040174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=62 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:45.878134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:10.557724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27b339-bc7c-42dd-b73d-5206b460ac5b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.558309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27b339-bc7c-42dd-b73d-5206b460ac5b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.558309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27b339-bc7c-42dd-b73d-5206b460ac5b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.559636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 598/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:10.564334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f0c5a-c284-4468-be0a-0ab70874e46a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.564761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f0c5a-c284-4468-be0a-0ab70874e46a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.564877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f0c5a-c284-4468-be0a-0ab70874e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.645751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e66f0c5a-c284-4468-be0a-0ab70874e46a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:10.646952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e66f0c5a-c284-4468-be0a-0ab70874e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.755502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 591/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:10.913905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27b339-bc7c-42dd-b73d-5206b460ac5b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.920460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5c27b339-bc7c-42dd-b73d-5206b460ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:11.032580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27b339-bc7c-42dd-b73d-5206b460ac5b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:11.037888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4793931-2b31-499d-8eec-082c3e640e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:11.038481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793931-2b31-499d-8eec-082c3e640e44 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.038758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793931-2b31-499d-8eec-082c3e640e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.039030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4793931-2b31-499d-8eec-082c3e640e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.047453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4793931-2b31-499d-8eec-082c3e640e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:11.049000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4793931-2b31-499d-8eec-082c3e640e44 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.058335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 599/1190] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:12.124223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16da30e-f328-4764-886a-e5533495674c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.124781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16da30e-f328-4764-886a-e5533495674c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.124781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16da30e-f328-4764-886a-e5533495674c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.126141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 592/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:12.131122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a536-3500-481f-9023-98e472f72826 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.131540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a536-3500-481f-9023-98e472f72826 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.131668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a536-3500-481f-9023-98e472f72826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.151665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7013a536-3500-481f-9023-98e472f72826 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:12.152830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7013a536-3500-481f-9023-98e472f72826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.160454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 600/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:12.311503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16da30e-f328-4764-886a-e5533495674c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.326420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16da30e-f328-4764-886a-e5533495674c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.331893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538a244-736d-4fb0-8a7a-1e381b5c817d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.332556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a244-736d-4fb0-8a7a-1e381b5c817d service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.332829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a244-736d-4fb0-8a7a-1e381b5c817d service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.333100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a244-736d-4fb0-8a7a-1e381b5c817d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.342140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538a244-736d-4fb0-8a7a-1e381b5c817d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.343780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538a244-736d-4fb0-8a7a-1e381b5c817d service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.353456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 593/1193] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:12.370347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5d34-60b8-4e50-8eca-134387c00d5f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.370630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5d34-60b8-4e50-8eca-134387c00d5f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.370902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d5d34-60b8-4e50-8eca-134387c00d5f None None] PATH_INFO: `/v3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.372212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 601/1194] 10.222.0.42 () {54 vars in 925 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:12.378430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b7af-ba62-46dc-8ba5-8cd4ef4cbf18 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.378783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b7af-ba62-46dc-8ba5-8cd4ef4cbf18 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.379058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b7af-ba62-46dc-8ba5-8cd4ef4cbf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.445018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f4b4b7af-ba62-46dc-8ba5-8cd4ef4cbf18 None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:12.446872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f4b4b7af-ba62-46dc-8ba5-8cd4ef4cbf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:12.465452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:12.523033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 594/1195] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Nov 2 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:21.602306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03ac39-3080-4140-9926-c8c9bcc4eb8c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.602768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03ac39-3080-4140-9926-c8c9bcc4eb8c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.602886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03ac39-3080-4140-9926-c8c9bcc4eb8c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.604904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 602/1196] 10.222.0.26 () {54 vars in 961 bytes} [Wed Nov 2 07:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:21.610073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144f92c-552d-4c54-9f62-34bc65280173 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.610516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144f92c-552d-4c54-9f62-34bc65280173 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.610619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144f92c-552d-4c54-9f62-34bc65280173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.629434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f144f92c-552d-4c54-9f62-34bc65280173 None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:21.630633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f144f92c-552d-4c54-9f62-34bc65280173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.638978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 595/1197] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Nov 2 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:21.646228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03ac39-3080-4140-9926-c8c9bcc4eb8c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.659776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03ac39-3080-4140-9926-c8c9bcc4eb8c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.664646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a173a-a509-4e3c-92aa-60a90a2c7997 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.665226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a173a-a509-4e3c-92aa-60a90a2c7997 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.665505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a173a-a509-4e3c-92aa-60a90a2c7997 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.665856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a173a-a509-4e3c-92aa-60a90a2c7997 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.674340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a173a-a509-4e3c-92aa-60a90a2c7997 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.675889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a173a-a509-4e3c-92aa-60a90a2c7997 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.685505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 603/1198] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:23.822623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e6b6-a85b-4c55-a68c-640aecf111d3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.823188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e6b6-a85b-4c55-a68c-640aecf111d3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.823188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e6b6-a85b-4c55-a68c-640aecf111d3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.824508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 596/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:23.829220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112df43-91ac-4258-b890-db608600a0fc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.829654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112df43-91ac-4258-b890-db608600a0fc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.829786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112df43-91ac-4258-b890-db608600a0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.850399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7112df43-91ac-4258-b890-db608600a0fc None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.851587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7112df43-91ac-4258-b890-db608600a0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.860229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 604/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.011028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e6b6-a85b-4c55-a68c-640aecf111d3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.025710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e6b6-a85b-4c55-a68c-640aecf111d3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.031219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56654cb4-45a3-4205-bafc-71b9df77a904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.031801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654cb4-45a3-4205-bafc-71b9df77a904 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.032077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654cb4-45a3-4205-bafc-71b9df77a904 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.032349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56654cb4-45a3-4205-bafc-71b9df77a904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.040331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654cb4-45a3-4205-bafc-71b9df77a904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.042530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56654cb4-45a3-4205-bafc-71b9df77a904 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.051824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 597/1201] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:25.107761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811c83f-a3b7-41ce-8007-532e6f701e68 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.108540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811c83f-a3b7-41ce-8007-532e6f701e68 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.108659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811c83f-a3b7-41ce-8007-532e6f701e68 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.109971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 605/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:25.114766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68c67-1ffd-4f7d-94dc-c8978c8c38c7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.115193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68c67-1ffd-4f7d-94dc-c8978c8c38c7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.115364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68c67-1ffd-4f7d-94dc-c8978c8c38c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.134909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-47b68c67-1ffd-4f7d-94dc-c8978c8c38c7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:25.136119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-47b68c67-1ffd-4f7d-94dc-c8978c8c38c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.143881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 598/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:25.294632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811c83f-a3b7-41ce-8007-532e6f701e68 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.309074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811c83f-a3b7-41ce-8007-532e6f701e68 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.314345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f714-033e-4239-8cb0-c40c042f9034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.314927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f714-033e-4239-8cb0-c40c042f9034 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.315201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f714-033e-4239-8cb0-c40c042f9034 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.315468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f714-033e-4239-8cb0-c40c042f9034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.323826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0f714-033e-4239-8cb0-c40c042f9034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.325365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0f714-033e-4239-8cb0-c40c042f9034 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.334398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 606/1204] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:29.413830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15379c-31e9-4001-aaea-df1a7770b270 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.414393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15379c-31e9-4001-aaea-df1a7770b270 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.414545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15379c-31e9-4001-aaea-df1a7770b270 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.416411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 599/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:29.421559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c36a6-05aa-483f-9a3a-796dfba4f00d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.421983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c36a6-05aa-483f-9a3a-796dfba4f00d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.422114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c36a6-05aa-483f-9a3a-796dfba4f00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.441899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b34c36a6-05aa-483f-9a3a-796dfba4f00d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:29.443094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b34c36a6-05aa-483f-9a3a-796dfba4f00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.450893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 607/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:29.740419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15379c-31e9-4001-aaea-df1a7770b270 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.742111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1b15379c-31e9-4001-aaea-df1a7770b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.820480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15379c-31e9-4001-aaea-df1a7770b270 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.824047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5537f4-0f57-49ee-acbc-685bfd9e651f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.824640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5537f4-0f57-49ee-acbc-685bfd9e651f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.824920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5537f4-0f57-49ee-acbc-685bfd9e651f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.825218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5537f4-0f57-49ee-acbc-685bfd9e651f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.834110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5537f4-0f57-49ee-acbc-685bfd9e651f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.835519 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5537f4-0f57-49ee-acbc-685bfd9e651f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.845298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 600/1207] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:31.961001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90cfb0-2c5a-479f-b3e7-e35f40a46cf1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.961532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90cfb0-2c5a-479f-b3e7-e35f40a46cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.961532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90cfb0-2c5a-479f-b3e7-e35f40a46cf1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.963423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 608/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:31.968748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b426f-3c1f-4135-bab9-31032a63c029 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.969156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b426f-3c1f-4135-bab9-31032a63c029 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.969307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b426f-3c1f-4135-bab9-31032a63c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.989293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cd9b426f-3c1f-4135-bab9-31032a63c029 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:31.990520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd9b426f-3c1f-4135-bab9-31032a63c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:31.998293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 601/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:32.283066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90cfb0-2c5a-479f-b3e7-e35f40a46cf1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:32.294344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90cfb0-2c5a-479f-b3e7-e35f40a46cf1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:32.297822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad034b5-b098-45b3-aebe-fe401b341cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:32.298409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad034b5-b098-45b3-aebe-fe401b341cec service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.298685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad034b5-b098-45b3-aebe-fe401b341cec service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.298956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad034b5-b098-45b3-aebe-fe401b341cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.307759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad034b5-b098-45b3-aebe-fe401b341cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:32.309154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad034b5-b098-45b3-aebe-fe401b341cec service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:32.318743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 609/1210] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:35.816068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46dc1-5c2e-4f1c-a625-72b2f417568a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.816632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46dc1-5c2e-4f1c-a625-72b2f417568a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.816632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46dc1-5c2e-4f1c-a625-72b2f417568a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.818055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 602/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:35.824017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cda2-71a0-4480-84a2-3fcc46e5afdc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.824469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cda2-71a0-4480-84a2-3fcc46e5afdc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.824553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cda2-71a0-4480-84a2-3fcc46e5afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.831982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:35.844443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-97e9cda2-71a0-4480-84a2-3fcc46e5afdc None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:35.845706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97e9cda2-71a0-4480-84a2-3fcc46e5afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.854077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 610/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:36.154525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb46dc1-5c2e-4f1c-a625-72b2f417568a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:36.156193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6cb46dc1-5c2e-4f1c-a625-72b2f417568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:36.220161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:36.235265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb46dc1-5c2e-4f1c-a625-72b2f417568a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:36.240570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b907ab-8088-4980-8590-9548b08948bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:36.240570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b907ab-8088-4980-8590-9548b08948bd service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:36.240570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b907ab-8088-4980-8590-9548b08948bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:36.240570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b907ab-8088-4980-8590-9548b08948bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:36.249393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b907ab-8088-4980-8590-9548b08948bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:36.250848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b907ab-8088-4980-8590-9548b08948bd service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:36.260294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 603/1213] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:38.380028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c216c-6d7f-4f79-a74f-ba1999fda8a0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.380582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c216c-6d7f-4f79-a74f-ba1999fda8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.380582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c216c-6d7f-4f79-a74f-ba1999fda8a0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.381939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 611/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:38.387709 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b37de-b006-4c45-868a-c822c7a72228 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.388110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b37de-b006-4c45-868a-c822c7a72228 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.388249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b37de-b006-4c45-868a-c822c7a72228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.407824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b62b37de-b006-4c45-868a-c822c7a72228 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:38.408989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b62b37de-b006-4c45-868a-c822c7a72228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:38.416592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 604/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:38.714754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c216c-6d7f-4f79-a74f-ba1999fda8a0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:38.716410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-586c216c-6d7f-4f79-a74f-ba1999fda8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:38.729093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c216c-6d7f-4f79-a74f-ba1999fda8a0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:38.732803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2876b7-4eae-453d-a097-83e6916c3180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:38.733385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2876b7-4eae-453d-a097-83e6916c3180 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.733701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2876b7-4eae-453d-a097-83e6916c3180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.733967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2876b7-4eae-453d-a097-83e6916c3180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.742605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2876b7-4eae-453d-a097-83e6916c3180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:38.744521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2876b7-4eae-453d-a097-83e6916c3180 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:38.753597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 612/1216] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:48.403015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=11 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:48.749519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:14.025439 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.026011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.026011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.053840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.055174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.067469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 605/1217] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.077854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.078868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.078868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.106838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.107966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.119823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 613/1218] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.129977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.140931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e46a0-8a27-46ae-b2e4-94a2a6cbe084 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.150107 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.151036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.151533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.152025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.153445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:14.153985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.155799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.172978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 606/1219] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:14.181026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.197876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1158c-3ef9-4927-86fb-f0a8ce5332fd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.205957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9e81-bbae-4a19-95cc-5934552f6117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.206594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9e81-bbae-4a19-95cc-5934552f6117 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.206871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9e81-bbae-4a19-95cc-5934552f6117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.207284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9e81-bbae-4a19-95cc-5934552f6117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.207938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f9e81-bbae-4a19-95cc-5934552f6117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.209848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f9e81-bbae-4a19-95cc-5934552f6117 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.378320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 614/1220] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:14.382994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.398305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaad215-46cc-4af9-924d-d1d7fbac2bbc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.473418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981340cf-0067-4b0e-b9d3-5b7a463c90c8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.473662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981340cf-0067-4b0e-b9d3-5b7a463c90c8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.473772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981340cf-0067-4b0e-b9d3-5b7a463c90c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.483990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.486340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.486340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.486340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.487404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.489736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.519080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-981340cf-0067-4b0e-b9d3-5b7a463c90c8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.520337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-981340cf-0067-4b0e-b9d3-5b7a463c90c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.539951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 615/1221] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:14.551012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.551337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.551558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.590088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.591331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.606148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 616/1222] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:14.619745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.624751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0acc3-b63b-4862-affa-e7da8220a9b2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.630275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.630809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.631086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.631353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.631999 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:14.632303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.633310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:43:14.633310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:43:14.633310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:43:14.634227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.650657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 607/1223] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/users => generated 303 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:14.652327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 617/1224] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:43:14.661465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.663400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.677168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b20674-4e2c-419e-b750-00f0e3bd18ef admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.681280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c319-4753-471f-b57c-9e02413f7e71 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.684766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f941c42-a381-4de5-8440-448080a6b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.685379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f941c42-a381-4de5-8440-448080a6b014 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.685811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f941c42-a381-4de5-8440-448080a6b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.686088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f941c42-a381-4de5-8440-448080a6b014 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.686728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f941c42-a381-4de5-8440-448080a6b014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.686855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.687467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.687800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.688206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.688621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f941c42-a381-4de5-8440-448080a6b014 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.691743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.693464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.713958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 608/1225] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:14.720510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.729551 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954ef6c-a5ee-4fa7-a67e-845803f05c70 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.740403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969f1b-2681-45c8-887a-6c6fe95ae753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.741079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969f1b-2681-45c8-887a-6c6fe95ae753 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.741358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969f1b-2681-45c8-887a-6c6fe95ae753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.741669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969f1b-2681-45c8-887a-6c6fe95ae753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.742392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969f1b-2681-45c8-887a-6c6fe95ae753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.744026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969f1b-2681-45c8-887a-6c6fe95ae753 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.760120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 609/1226] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:14.761439 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.762485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.762769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.784575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.785989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.797656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 610/1227] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.798585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.825033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7966e47-e1e1-4ef5-a66f-658033e27534 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.829294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 618/1228] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:14.832022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d143b0-09d4-462f-bf86-b7bbd2162ea3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.832303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d143b0-09d4-462f-bf86-b7bbd2162ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.833047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d143b0-09d4-462f-bf86-b7bbd2162ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.872101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c1d143b0-09d4-462f-bf86-b7bbd2162ea3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.877663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c1d143b0-09d4-462f-bf86-b7bbd2162ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.923928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f44694-f04e-4b76-8e4a-3921f4577966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.924693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f44694-f04e-4b76-8e4a-3921f4577966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.925090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f44694-f04e-4b76-8e4a-3921f4577966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.925361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f44694-f04e-4b76-8e4a-3921f4577966 admin admin] PATH_INFO: `/v3/projects/38d08f66dcb047ab86aeb7110476298a/users/58e7d45f42934dddb64b6ce036b785d1/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.940886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f44694-f04e-4b76-8e4a-3921f4577966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d08f66dcb047ab86aeb7110476298a, user_id=58e7d45f42934dddb64b6ce036b785d1, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.943549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f44694-f04e-4b76-8e4a-3921f4577966 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.953832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 619/1229] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.956316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.956316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.956316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.974960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.976204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.985012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 620/1230] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.985861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.995070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144580a-a304-4c6f-aff4-8636fe69cdd6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.000280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.000853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.001126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.001391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.002062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.003060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:43:15.003060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:43:15.003060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:43:15.004233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b2394-bd83-4bbb-bb05-aee70ab77b87 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.004686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 611/1231] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:14 2022] PUT /identity/v3/projects/38d08f66dcb047ab86aeb7110476298a/users/58e7d45f42934dddb64b6ce036b785d1/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:15.009862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b91b7-f734-408b-bbe9-f47bb2516b52 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.009862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b91b7-f734-408b-bbe9-f47bb2516b52 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.009862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b91b7-f734-408b-bbe9-f47bb2516b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.026301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0c5b91b7-f734-408b-bbe9-f47bb2516b52 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.027593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0c5b91b7-f734-408b-bbe9-f47bb2516b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.046105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:15.085126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 612/1232] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.093474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 621/1233] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:15.094759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de530-ce2d-40ab-8fc9-9e3e9145abc5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.094953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea672042-57a8-4a00-a13b-6402eca776da None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.095065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de530-ce2d-40ab-8fc9-9e3e9145abc5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.095250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea672042-57a8-4a00-a13b-6402eca776da None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.095367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0de530-ce2d-40ab-8fc9-9e3e9145abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.095525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea672042-57a8-4a00-a13b-6402eca776da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.115325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ea672042-57a8-4a00-a13b-6402eca776da None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.115537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bd0de530-ce2d-40ab-8fc9-9e3e9145abc5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.116527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ea672042-57a8-4a00-a13b-6402eca776da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.116903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd0de530-ce2d-40ab-8fc9-9e3e9145abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.124518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 613/1234] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.134485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 622/1235] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.134658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e2b7-c386-41c4-9abb-0fb9f776810d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.134658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e2b7-c386-41c4-9abb-0fb9f776810d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.134872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.134990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929e2b7-c386-41c4-9abb-0fb9f776810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.135086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.135086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.154189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.154808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5929e2b7-c386-41c4-9abb-0fb9f776810d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.155382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.155987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5929e2b7-c386-41c4-9abb-0fb9f776810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.163218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 623/1236] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.167050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.167189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 614/1237] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.167189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ab5d-42dc-4471-b609-0f2a802d0ecc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.167189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ab5d-42dc-4471-b609-0f2a802d0ecc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.167189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1ab5d-42dc-4471-b609-0f2a802d0ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.177471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98304-19cc-4f7a-baa2-588a3ad96528 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.182053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.182753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.183089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.183368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.184563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:15.184858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.186474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d2cb-d86f-4d52-9d6a-9fe44cdb9853 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.198342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 624/1238] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:15.198513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-78a1ab5d-42dc-4471-b609-0f2a802d0ecc None None] MFA Rules not processed for user `58e7d45f42934dddb64b6ce036b785d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.200058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.200193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-78a1ab5d-42dc-4471-b609-0f2a802d0ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.200337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.200606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.219183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.220366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.228731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 625/1239] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.229563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.240005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208caa6b-97cc-40d0-848c-e435bf2e7abc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.244524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6ca0-f78c-408c-84d9-e015e0a46a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.245099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6ca0-f78c-408c-84d9-e015e0a46a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.245376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6ca0-f78c-408c-84d9-e015e0a46a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.245672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6ca0-f78c-408c-84d9-e015e0a46a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.246840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a6ca0-f78c-408c-84d9-e015e0a46a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.248370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a6ca0-f78c-408c-84d9-e015e0a46a45 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.260973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 626/1240] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:15.260973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.260973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.260973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.270734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 615/1241] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.271970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1c11-dcec-446e-b7e4-7dfbd38ce3b1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.272256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1c11-dcec-446e-b7e4-7dfbd38ce3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.272658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1c11-dcec-446e-b7e4-7dfbd38ce3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.273852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:15.280026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.281902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.289395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 627/1242] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.290232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.292818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ecac1c11-dcec-446e-b7e4-7dfbd38ce3b1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.294062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ecac1c11-dcec-446e-b7e4-7dfbd38ce3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.299778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecc960-451d-40dd-832d-14a83115b5b5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.302521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 616/1243] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.303799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.304098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.304344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.305389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.306093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.306429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.306797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.307381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:15.307689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.309825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.328941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 628/1244] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:15.328941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.329207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.329207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.333318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6c350-ce33-4446-9299-6c29f7420ef3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.334162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 617/1245] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.335026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.338441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.339143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.339578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.340003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.340727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.342728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.344335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53488727-1b05-49a3-bf4a-56321ec8c3d5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.348860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.349461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.349747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.350023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.350660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:15.350983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.352787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.364298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 618/1246] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:15.365152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.375204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71629b-21f5-4d33-a3c1-c3335195d780 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.379907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.380475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.380772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.381042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.381692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.383229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.394092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 619/1247] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:15.394842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.403976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2100d-0b8c-465f-ae53-e2570b42b14d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.408464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.409000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.409277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.409562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.410177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.411156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:43:15.411156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:43:15.411156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:43:15.412300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.425882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 629/1248] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:15.426774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.489442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea477e7-5de4-4225-971d-deebc22d4fc1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.494121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.494722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.495002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.495278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.495935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:15.496746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.498366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.503167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 620/1249] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:15.504059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.511790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 630/1250] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:15.513144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.524255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a4482-cba5-47a2-adb2-2290d57b4151 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.552061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:15.570205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643342d-a225-4b7e-b7f3-0e135e28a759 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.575125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.575791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.576076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.576346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.576980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:15.577279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.578969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.579897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.580500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.580783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.581063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.581721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.583597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.591895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 621/1251] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:15.592997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.602818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b9534-cac8-4a57-9aaa-0d0624815db3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.608414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.608998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.609273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.609559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.610217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:15.610513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.612075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.624643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 622/1252] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:15.625527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.634997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd9f1-c016-40fe-a13b-eeeb3d973c4c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.639672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.640260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.640546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.640819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.641448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.643340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.679795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 631/1253] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:15.680615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.724541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:15.725843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 623/1254] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:15.726921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.744443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5041-fc0b-4634-8ed3-d9929640e344 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.789614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2614eb-60c3-4401-a507-3004cec65388 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.794830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.795483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.795763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.796033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.796658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.798595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.802283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.802943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.803226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.803503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] PATH_INFO: `/v3/projects/a392f0c9edd24290bd66eb29f9679688/users/f95e04e3b36d4edc944881a5e4a96b81/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.818438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a392f0c9edd24290bd66eb29f9679688, user_id=f95e04e3b36d4edc944881a5e4a96b81, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.821149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.889628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 624/1255] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:15.890621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.900462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930b53-13d1-4349-bb27-9aa21783ef43 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.901928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 632/1256] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:15 2022] PUT /identity/v3/projects/a392f0c9edd24290bd66eb29f9679688/users/f95e04e3b36d4edc944881a5e4a96b81/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:15.903314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.961258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.961883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.962162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.962434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.963059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.964620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4953e3-2e55-4bae-8922-fff1f060b6dc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.965475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.969860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.970467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.970747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.971156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.971810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.973747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.050015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 625/1257] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.050745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.060344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f774e6-78d0-476a-9196-5e6e695bbc27 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.065029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.065622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.072459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.072459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.072459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.072459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.073902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 633/1258] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.074606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.137689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c82a0-24f3-4623-8afb-b75a1d7c445a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.139134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.142710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.149285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.149285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.149285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.149285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.149716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 626/1259] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.149811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.149909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.151359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.210272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d24ed-ad71-4932-a0d1-78fe44a1b0c1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.215496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.216092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.216371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.216709 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.217370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.219337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.233091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 634/1260] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.239713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.293205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cc59-72f0-4437-bd13-0e26c952a448 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.297803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.298400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.298675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.302904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 627/1261] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.303029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.303133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.303235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.303235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.309257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6efa4-3af2-4490-a2fa-3b700921f0ac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.314455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf6414-5269-4ffe-b77f-f23ecc9370e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.315030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf6414-5269-4ffe-b77f-f23ecc9370e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.315306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf6414-5269-4ffe-b77f-f23ecc9370e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.315598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf6414-5269-4ffe-b77f-f23ecc9370e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.316224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf6414-5269-4ffe-b77f-f23ecc9370e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.317831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf6414-5269-4ffe-b77f-f23ecc9370e9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.328720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 628/1262] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.331602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.331602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.331602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.357451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] MFA Rules not processed for user `f95e04e3b36d4edc944881a5e4a96b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:16.358716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:16.385586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 635/1263] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.386243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.397172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7258-a284-4186-aa5e-0f37bf5c2be4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.401814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.402935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.403231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.403490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.404191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.405738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.415623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 636/1264] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.416385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.425506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bf381-bf2a-4767-b799-457c4872f950 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.430087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.430641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.430917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.431119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 629/1265] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:16.435921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.435921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.436115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.436194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.443917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa15142-4667-4857-9af5-ba2b8cd90c72 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.450933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.451532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.451811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.452111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.452738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.454663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.527819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 637/1266] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.529914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.539517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77309-5820-409a-b10b-9c074221c05d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.544643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.545451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.547207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.547747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.548373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.550322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.554976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 630/1267] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.554976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.563418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62e162-7f14-42c0-bee8-18f6452115b9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.568380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.568972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.569254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.569526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.570258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.575168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.584879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 631/1268] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.585516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.595500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c762276-fa87-4816-938e-5703bd197306 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.600184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.601575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.601575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.601575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.602252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.603788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.613969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 632/1269] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.614812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.624112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72000-4324-448b-987a-5fb6c631a32b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.630002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 638/1270] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:16.630002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.630240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c01eeb-e777-44a8-bb2b-7edd75dbf0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.630240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01eeb-e777-44a8-bb2b-7edd75dbf0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.630240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01eeb-e777-44a8-bb2b-7edd75dbf0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.630240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01eeb-e777-44a8-bb2b-7edd75dbf0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.630911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01eeb-e777-44a8-bb2b-7edd75dbf0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.632341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01eeb-e777-44a8-bb2b-7edd75dbf0d4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.641476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9267-4f4a-4dd8-85e0-0f1c68aa2584 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.643187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 633/1271] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.644415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5b2b-3714-4697-8c83-14b31411f6f7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.644708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5b2b-3714-4697-8c83-14b31411f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.644976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5b2b-3714-4697-8c83-14b31411f6f7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.646274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 634/1272] 10.222.0.26 () {54 vars in 961 bytes} [Wed Nov 2 07:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:16.647023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5b2b-3714-4697-8c83-14b31411f6f7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.649370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.650047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.650331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.650603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] PATH_INFO: `/v3/projects/6add37c250f94fc6a2f10782acd4ad0a/users/268316c1168446938f33a238f0d3d75b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.660014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5b2b-3714-4697-8c83-14b31411f6f7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.664435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.664999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.665276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.665534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.666026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6add37c250f94fc6a2f10782acd4ad0a, user_id=268316c1168446938f33a238f0d3d75b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.666292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.667831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.668652 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.678431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 635/1273] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.679335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.685837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.689251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff459e-0dfe-4375-ba22-5367b5cea2be admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.693915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.694485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.694762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.695034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.695647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.697290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.707357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 636/1274] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.708841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.717497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e7949-8691-4553-bf6d-bee3424458bc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.721954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.722492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.722769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.723038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.723628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.725118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.733797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 639/1275] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:16 2022] PUT /identity/v3/projects/6add37c250f94fc6a2f10782acd4ad0a/users/268316c1168446938f33a238f0d3d75b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:16.734742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.735108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 637/1276] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.735890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.747080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff64481-d7d2-4d41-8887-46c680667b10 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.803330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b122-4c4a-477d-b8d7-4bd5e9b760ae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.805417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.806178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.806468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.806740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.807376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.809092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.809451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.809854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.810137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.812100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] PATH_INFO: `/v3/projects/f7ca4d5eb68e4e79bc69fcfd13289491/users/429fa7f2640a4b8d9e9ad48002bf2425/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.818646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.819551 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 638/1277] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.820375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.828326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ca4d5eb68e4e79bc69fcfd13289491, user_id=429fa7f2640a4b8d9e9ad48002bf2425, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.831078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8c485-6264-4392-8c72-8e483961f798 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:16.831202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.835967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10d56d-93a9-4679-91eb-cfe2ecf67f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:16.836578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10d56d-93a9-4679-91eb-cfe2ecf67f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.836856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10d56d-93a9-4679-91eb-cfe2ecf67f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.837126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10d56d-93a9-4679-91eb-cfe2ecf67f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.837814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10d56d-93a9-4679-91eb-cfe2ecf67f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:16.839636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10d56d-93a9-4679-91eb-cfe2ecf67f89 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:16.851951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 639/1278] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:16.857215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.857215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.857215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.891975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:16.893167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:16.941774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 640/1279] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:16 2022] PUT /identity/v3/projects/f7ca4d5eb68e4e79bc69fcfd13289491/users/429fa7f2640a4b8d9e9ad48002bf2425/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:16.942417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.960038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 640/1280] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:16.962443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:16.971099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda64b1b-53e0-4fff-a415-96565141af1d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.015037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff3d0-015a-42be-98b8-4ec43899f1aa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.015568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.019741 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.020349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.020836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.021086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.021750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.023327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.027777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.028483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.028761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.029031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.029682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.031244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.033499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 641/1281] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:17.034320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.044410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 641/1282] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:17.044410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.044660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccca59-190f-4ca8-8401-e79686f5ed05 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.049283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.049899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.050179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.050451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.051200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.051660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096ac3b-a940-42c0-a728-4d849d5678bf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.052773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.056223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be794f30-f30d-4e2a-a9ad-14cb08d7b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.056790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794f30-f30d-4e2a-a9ad-14cb08d7b807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.057067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794f30-f30d-4e2a-a9ad-14cb08d7b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.057339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794f30-f30d-4e2a-a9ad-14cb08d7b807 admin admin] PATH_INFO: `/v3/projects/d18554e041ba4f9999b1d9763bf67ff0/users/d906a82c15bb400390784907a53a3652/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.067570 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 642/1283] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:17.067570 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.072713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be794f30-f30d-4e2a-a9ad-14cb08d7b807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18554e041ba4f9999b1d9763bf67ff0, user_id=d906a82c15bb400390784907a53a3652, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.075989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be794f30-f30d-4e2a-a9ad-14cb08d7b807 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.076110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cbbab-0cbd-4058-96ef-a000132c7dab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.080721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.081311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.081631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.081911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.082605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.084184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.095777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 643/1284] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:17.096539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.106071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634a7d5-b5f1-49b2-a916-77264c9019da admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.110595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.111193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.111466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.111739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] PATH_INFO: `/v3/projects/b2268641d1c54776a534a9285c121311/users/db7ac95c081043f9b0a221d5624c2a7b/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.125760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2268641d1c54776a534a9285c121311, user_id=db7ac95c081043f9b0a221d5624c2a7b, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.128414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.159181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 642/1285] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/d18554e041ba4f9999b1d9763bf67ff0/users/d906a82c15bb400390784907a53a3652/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:17.160448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.160800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.161007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.179159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.180347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.202562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 644/1286] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/b2268641d1c54776a534a9285c121311/users/db7ac95c081043f9b0a221d5624c2a7b/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:17.204104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.241872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 643/1287] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.242724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.251996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599e660-f4e7-4bfe-bb8a-05e586baf9d7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.285378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42ac2b-dfa9-49ee-afe2-9060e0bbfecc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.290836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.291433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.291708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.291976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.308235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.308825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.309108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.309383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] PATH_INFO: `/v3/projects/e278a2c2980d4a60bdde8108a8b9686f/users/a4c7afb29947409987144dc5038a679f/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.323587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.324830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e278a2c2980d4a60bdde8108a8b9686f, user_id=a4c7afb29947409987144dc5038a679f, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.327537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.349287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.350997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.360057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 645/1288] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:17.360811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.370086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5c80a-9891-4aa0-8c2c-8f22cc533d7f service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.374666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.375280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.375556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.375834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] PATH_INFO: `/v3/projects/5eb23720bea740eea688e561b98b5121/users/a881b31e78e7433bb3eab1608884ae1e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.387885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 644/1289] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/e278a2c2980d4a60bdde8108a8b9686f/users/a4c7afb29947409987144dc5038a679f/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:17.388573 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.400895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb23720bea740eea688e561b98b5121, user_id=a881b31e78e7433bb3eab1608884ae1e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.405079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.435170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.453068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585efcbb-7e01-40f1-ad3a-155e56560791 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.459757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 646/1290] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/5eb23720bea740eea688e561b98b5121/users/a881b31e78e7433bb3eab1608884ae1e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:17.459757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.520254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb079-9190-4587-ac9b-e23747836518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.520908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb079-9190-4587-ac9b-e23747836518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.521184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb079-9190-4587-ac9b-e23747836518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.521452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb079-9190-4587-ac9b-e23747836518 admin admin] PATH_INFO: `/v3/projects/6add37c250f94fc6a2f10782acd4ad0a/users/268316c1168446938f33a238f0d3d75b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.522474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffd7f-b8aa-4687-aeaa-5a29863a6ad6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.523376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eb079-9190-4587-ac9b-e23747836518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6add37c250f94fc6a2f10782acd4ad0a, user_id=268316c1168446938f33a238f0d3d75b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.526070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9eb079-9190-4587-ac9b-e23747836518 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.527826 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6d493-65f8-481c-bcf8-1c60c7bc2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.528572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6d493-65f8-481c-bcf8-1c60c7bc2b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.529020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6d493-65f8-481c-bcf8-1c60c7bc2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.529385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6d493-65f8-481c-bcf8-1c60c7bc2b3a admin admin] PATH_INFO: `/v3/projects/20acd5f2f33f4da8a4ef61363a283844/users/33ef03ba2d8c43d6a745490b9ea2afdf/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.537450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 645/1291] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/6add37c250f94fc6a2f10782acd4ad0a/users/268316c1168446938f33a238f0d3d75b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:17.538500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.538778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.539049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.545441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6d493-65f8-481c-bcf8-1c60c7bc2b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20acd5f2f33f4da8a4ef61363a283844, user_id=33ef03ba2d8c43d6a745490b9ea2afdf, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.548657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6d493-65f8-481c-bcf8-1c60c7bc2b3a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.566950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] MFA Rules not processed for user `d906a82c15bb400390784907a53a3652`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.568120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.618233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 647/1292] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:17 2022] PUT /identity/v3/projects/20acd5f2f33f4da8a4ef61363a283844/users/33ef03ba2d8c43d6a745490b9ea2afdf/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:17.618233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a38b2-93c4-4234-a89c-85182850d5d6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.618233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a38b2-93c4-4234-a89c-85182850d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.618233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a38b2-93c4-4234-a89c-85182850d5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.634304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 646/1293] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.635352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.645613 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bd7a38b2-93c4-4234-a89c-85182850d5d6 None None] MFA Rules not processed for user `db7ac95c081043f9b0a221d5624c2a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.646818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd7a38b2-93c4-4234-a89c-85182850d5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.690485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2249a4-f20f-4d8c-acc2-ddc0a9506d66 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.711997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 648/1294] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.713246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc1fe-c638-4d7d-a78c-e45acd8cbd0b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.714280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc1fe-c638-4d7d-a78c-e45acd8cbd0b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.714280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc1fe-c638-4d7d-a78c-e45acd8cbd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.719992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.743348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-212bc1fe-c638-4d7d-a78c-e45acd8cbd0b None None] MFA Rules not processed for user `a4c7afb29947409987144dc5038a679f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.744534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-212bc1fe-c638-4d7d-a78c-e45acd8cbd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.748071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa438e97-f106-4b35-af4b-26c027be6a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.748071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438e97-f106-4b35-af4b-26c027be6a64 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.748071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438e97-f106-4b35-af4b-26c027be6a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.748071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438e97-f106-4b35-af4b-26c027be6a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.755644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.807955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa438e97-f106-4b35-af4b-26c027be6a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.809443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa438e97-f106-4b35-af4b-26c027be6a64 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.809734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 649/1295] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.811054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506029-d312-4a2f-80f6-f1347ac9633b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.811364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506029-d312-4a2f-80f6-f1347ac9633b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.811618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506029-d312-4a2f-80f6-f1347ac9633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.819378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 647/1296] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:17.820560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a4101-0c03-4d92-bf02-6fb70524ba30 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.820835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a4101-0c03-4d92-bf02-6fb70524ba30 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.821115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a4101-0c03-4d92-bf02-6fb70524ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.839466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-30506029-d312-4a2f-80f6-f1347ac9633b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.841424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-30506029-d312-4a2f-80f6-f1347ac9633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.850602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 650/1297] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.852020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a9d8-4220-4427-a47c-3c27ef1e9b4a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.852301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a9d8-4220-4427-a47c-3c27ef1e9b4a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.852600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a9d8-4220-4427-a47c-3c27ef1e9b4a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.853887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 651/1298] 10.222.0.26 () {54 vars in 912 bytes} [Wed Nov 2 07:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:17.854908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.855190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.855496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.855851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c92a4101-0c03-4d92-bf02-6fb70524ba30 None None] MFA Rules not processed for user `268316c1168446938f33a238f0d3d75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.857177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c92a4101-0c03-4d92-bf02-6fb70524ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.874195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.875425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:17.883131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 652/1299] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.887226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.893694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44b5dc-b86e-4d1d-8d5f-e2216c71f680 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.898468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3fba-11a8-4aba-8291-90a0c5950423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.899069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3fba-11a8-4aba-8291-90a0c5950423 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.899352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3fba-11a8-4aba-8291-90a0c5950423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.899629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3fba-11a8-4aba-8291-90a0c5950423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.902889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3fba-11a8-4aba-8291-90a0c5950423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.902889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3fba-11a8-4aba-8291-90a0c5950423 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.928687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 648/1300] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:17.930151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501bed-fb85-4aa4-ae6e-2b8818dba35a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.930439 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501bed-fb85-4aa4-ae6e-2b8818dba35a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.930728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501bed-fb85-4aa4-ae6e-2b8818dba35a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.931930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 649/1301] 10.222.0.26 () {54 vars in 961 bytes} [Wed Nov 2 07:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:17.932761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501bed-fb85-4aa4-ae6e-2b8818dba35a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:17.946627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501bed-fb85-4aa4-ae6e-2b8818dba35a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:17.951842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:17.952437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.952718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.952993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.953659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:17.955598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:17.977578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 653/1302] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:17.978864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:17.979217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:17.979558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:17.998361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:17.999559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:18.065005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 654/1303] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:18.065883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.081339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 650/1304] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:17 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:18.082312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.130035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0d9a5-4eb5-46db-99b6-9b4f8deb415c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.149246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be94470-a44a-4e1c-931a-a286ad7f8cb7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.149246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:18.158338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375250b-b176-4a1f-8728-0e8a3de1236c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.159998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375250b-b176-4a1f-8728-0e8a3de1236c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.160768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375250b-b176-4a1f-8728-0e8a3de1236c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.161702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375250b-b176-4a1f-8728-0e8a3de1236c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.187260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.187876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.188153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.188546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.225088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:18.243557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375250b-b176-4a1f-8728-0e8a3de1236c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.244999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375250b-b176-4a1f-8728-0e8a3de1236c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.255987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 651/1305] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:18.257371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.259523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.259523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.259732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.260385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.272238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 655/1306] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:18.273121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.278755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:18.281084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:18.337029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce1180-253e-47fc-aae2-e50ac308ff1f service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.341207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.341944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.342224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.342497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.351491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 652/1307] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Nov 2 07:43:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:18.352324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.361975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979fd2-f046-47fa-8b3b-a741e7ec8dac None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.366494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.368257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.368257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.368257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.368257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.370201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.402700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.404178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.413809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 656/1308] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:18.414629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.424860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec354ef-bf66-4b47-a0df-a9edac9b9862 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.427390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.428060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.428527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.428885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.440159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.442127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.455815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 657/1309] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:18.456680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.467012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de9cf4-9281-4475-a785-e2ed995d64d7 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.475894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.479847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 653/1310] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:18 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:18.483016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.484001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.484296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.484553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.485207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.487404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.522558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7b9a6-9e8c-4f95-93fc-ed4a3af512c5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.550018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.550461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.550751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.550937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.552088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:18.615021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 658/1311] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:18 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:18.616039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.635223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62daf39-8cb3-4a4f-9946-6b2cfdd9aab4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.640699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.641351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.644825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.644825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.644825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.644825 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.658233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 659/1312] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:18.659155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.667572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.673589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.673726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca793dc5-4d9c-4d86-8c98-7a13aebc9336 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.676303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.676910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.677190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.677463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.678150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.679734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.685576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 654/1313] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:18.687246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.696074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:18.703251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219b6f-1dea-4e84-a6b7-61005637060a service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.709307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.710336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.710843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.711323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] PATH_INFO: `/v3/users/58e7d45f42934dddb64b6ce036b785d1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.715107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 660/1314] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:18.716196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.716636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e7d45f42934dddb64b6ce036b785d1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.718517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:43:18.718517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: warnings.warn(msg) Nov 02 07:43:18.718517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: Nov 02 07:43:18.721229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.738598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba47635-aa49-482d-8e34-f7b82de7e0d9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.752296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.754977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.755481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.758972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] PATH_INFO: `/v3/projects/d76efe52ba9146c582bbf06e5878b024/users/bbc2958591714fad971419c150c1ef58/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.800893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76efe52ba9146c582bbf06e5878b024, user_id=bbc2958591714fad971419c150c1ef58, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.807658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.948462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 661/1315] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:18 2022] PUT /identity/v3/projects/d76efe52ba9146c582bbf06e5878b024/users/bbc2958591714fad971419c150c1ef58/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:18.950148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.997364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e7d45f42934dddb64b6ce036b785d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:18.998378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e7d45f42934dddb64b6ce036b785d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:19.019640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e7d45f42934dddb64b6ce036b785d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:19.032040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e7d45f42934dddb64b6ce036b785d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:19.032734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e7d45f42934dddb64b6ce036b785d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:19.042191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287657fe-bc3c-4900-965f-49274edd0aaf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.042191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb869c9-c338-4a56-9a0f-cd1948f3bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.042191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb869c9-c338-4a56-9a0f-cd1948f3bf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.042191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb869c9-c338-4a56-9a0f-cd1948f3bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.042770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb869c9-c338-4a56-9a0f-cd1948f3bf5b admin admin] PATH_INFO: `/v3/projects/49aad0518fe24d3db1f7781e412b6bde/users/460e529238ae4badbe9737b301e0ff19/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.057515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb869c9-c338-4a56-9a0f-cd1948f3bf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49aad0518fe24d3db1f7781e412b6bde, user_id=460e529238ae4badbe9737b301e0ff19, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.061000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb869c9-c338-4a56-9a0f-cd1948f3bf5b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.151796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 655/1316] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:18 2022] DELETE /identity/v3/users/58e7d45f42934dddb64b6ce036b785d1 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:19.153289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.154939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.209749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 662/1317] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:18 2022] PUT /identity/v3/projects/49aad0518fe24d3db1f7781e412b6bde/users/460e529238ae4badbe9737b301e0ff19/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:19.211374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22acfd-253c-49ff-907a-dab5588cf473 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.212049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22acfd-253c-49ff-907a-dab5588cf473 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.212612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22acfd-253c-49ff-907a-dab5588cf473 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.214338 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 663/1318] 10.222.0.26 () {54 vars in 912 bytes} [Wed Nov 2 07:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:19.215757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437a818-167a-4902-b95b-32223e620da9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.216106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437a818-167a-4902-b95b-32223e620da9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.216490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437a818-167a-4902-b95b-32223e620da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.251670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e437a818-167a-4902-b95b-32223e620da9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:19.253491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e437a818-167a-4902-b95b-32223e620da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.284805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21995b8-3c86-4aaa-a4d8-55c3ee95fdc6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.355803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 664/1319] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:19.356716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437a818-167a-4902-b95b-32223e620da9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.358159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e437a818-167a-4902-b95b-32223e620da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.359706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa60518-6e47-40e8-bc5b-5121c78ac856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.361396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60518-6e47-40e8-bc5b-5121c78ac856 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.364862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60518-6e47-40e8-bc5b-5121c78ac856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.365210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa60518-6e47-40e8-bc5b-5121c78ac856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.368932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa60518-6e47-40e8-bc5b-5121c78ac856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.370703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa60518-6e47-40e8-bc5b-5121c78ac856 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.379013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437a818-167a-4902-b95b-32223e620da9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.383173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 656/1320] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:19.384377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.385146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.385481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.385804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.386855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.387546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434c28-70b2-47af-b255-1cc2ec7a868b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.387837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434c28-70b2-47af-b255-1cc2ec7a868b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.388111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434c28-70b2-47af-b255-1cc2ec7a868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.388499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.415646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 665/1321] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:19.416767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.419581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.439509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fb434c28-70b2-47af-b255-1cc2ec7a868b None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:19.441064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fb434c28-70b2-47af-b255-1cc2ec7a868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.458048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:19.474821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:19.497923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3efb65-3318-43c8-9132-0c5d653eb80e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.502205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.506824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.506824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.506824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.513988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.515716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.530401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 666/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:19.535090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.549381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b61c5-d1de-47a2-8fa7-3727433e6198 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.555554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.556767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.556926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.557436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] PATH_INFO: `/v3/projects/d76efe52ba9146c582bbf06e5878b024/users/bbc2958591714fad971419c150c1ef58/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.565715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76efe52ba9146c582bbf06e5878b024, user_id=bbc2958591714fad971419c150c1ef58, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.565715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.584891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 667/1323] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:19 2022] PUT /identity/v3/projects/d76efe52ba9146c582bbf06e5878b024/users/bbc2958591714fad971419c150c1ef58/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:19.584891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.604380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 657/1324] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:19.606495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4605d-89d5-492d-89ff-5ab25c78ad3b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.606784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4605d-89d5-492d-89ff-5ab25c78ad3b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.607064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4605d-89d5-492d-89ff-5ab25c78ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.684754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f1cfa-a8f3-4323-bce3-baf401b895b4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.689150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-42d4605d-89d5-492d-89ff-5ab25c78ad3b None None] MFA Rules not processed for user `bbc2958591714fad971419c150c1ef58`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:19.690505 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-42d4605d-89d5-492d-89ff-5ab25c78ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.692386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.693296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.695261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.695631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] PATH_INFO: `/v3/projects/49aad0518fe24d3db1f7781e412b6bde/users/460e529238ae4badbe9737b301e0ff19/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.698288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49aad0518fe24d3db1f7781e412b6bde, user_id=460e529238ae4badbe9737b301e0ff19, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.701952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.718105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 668/1325] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:19 2022] PUT /identity/v3/projects/49aad0518fe24d3db1f7781e412b6bde/users/460e529238ae4badbe9737b301e0ff19/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:19.719286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.723443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.835748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8221b5e-15c7-40aa-b8f1-7478f2a161b3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.849800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.852328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.853584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.854823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.884278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 658/1326] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:19.885559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.887906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.888275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.944683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] MFA Rules not processed for user `460e529238ae4badbe9737b301e0ff19`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:19.951544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:20.006687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:20.040080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:20.041596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:20.076856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 669/1327] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:20.077859 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:20.083852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:20.112997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec31e-0579-4d5a-9a81-eb744ffa27bb service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:20.122768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:20.124828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.125488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.126283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.126795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 659/1328] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:20.217295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:20.219677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:20.233830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 670/1329] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:20.381927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:20.401475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452aee7-5d9c-48cc-a3da-94ffbdc914bc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:20.406187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:20.407076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.407616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.408161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.428617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:20.430951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:20.453276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 660/1330] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:20.573958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:20.575935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:20.713967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e36fd-85ea-4ffc-9a69-82d373d8072d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:20.720960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:20.722279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.722540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.722914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] PATH_INFO: `/v3/projects/38d08f66dcb047ab86aeb7110476298a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.723927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d08f66dcb047ab86aeb7110476298a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:20.725768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:43:20.725768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: warnings.warn(msg) Nov 02 07:43:20.725768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: Nov 02 07:43:20.727814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:20.966425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d08f66dcb047ab86aeb7110476298a', 'request_id': 'req-4201f8c6-67fb-436f-8caa-27707954213d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:20.987399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d08f66dcb047ab86aeb7110476298a', 'request_id': 'req-4201f8c6-67fb-436f-8caa-27707954213d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.021956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:21.033124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782385ed-fafa-4b8c-b180-5d9346c91145 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:21.044025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:21.097779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d08f66dcb047ab86aeb7110476298a', 'request_id': 'req-4201f8c6-67fb-436f-8caa-27707954213d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.119107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] The token cache is being invalidate because project 38d08f66dcb047ab86aeb7110476298a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:21.119547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.122068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.124326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 671/1331] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:20 2022] DELETE /identity/v3/projects/38d08f66dcb047ab86aeb7110476298a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:21.128237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:21.130647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.146450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:21.147737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:21.148716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:21.148879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:21.149144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:21.151634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.303827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201f8c6-67fb-436f-8caa-27707954213d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:21.306563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:21.308571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:21.315067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:21.315800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:21.316068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:21.316349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] PATH_INFO: `/v3/users/268316c1168446938f33a238f0d3d75b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:21.321850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=268316c1168446938f33a238f0d3d75b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:21.325937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:21.332763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 661/1332] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:21.586009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268316c1168446938f33a238f0d3d75b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.587006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268316c1168446938f33a238f0d3d75b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.604397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268316c1168446938f33a238f0d3d75b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.695639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268316c1168446938f33a238f0d3d75b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.731712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-512b9610-9ee7-4aff-9921-36209e157771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268316c1168446938f33a238f0d3d75b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.763331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 672/1333] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:21 2022] DELETE /identity/v3/users/268316c1168446938f33a238f0d3d75b => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:23.036534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:23.056661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38289-979d-4e96-be61-afa4c94b5b2c service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:23.241061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:23.242154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:23.242785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:23.243222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] PATH_INFO: `/v3/projects/6add37c250f94fc6a2f10782acd4ad0a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:23.244586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6add37c250f94fc6a2f10782acd4ad0a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:23.246738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:23.444903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6add37c250f94fc6a2f10782acd4ad0a', 'request_id': 'req-98f23187-3cd0-4901-b366-273314db7134'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.473242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6add37c250f94fc6a2f10782acd4ad0a', 'request_id': 'req-98f23187-3cd0-4901-b366-273314db7134'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.584589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6add37c250f94fc6a2f10782acd4ad0a', 'request_id': 'req-98f23187-3cd0-4901-b366-273314db7134'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.590925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:23.607878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] The token cache is being invalidate because project 6add37c250f94fc6a2f10782acd4ad0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:23.610357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.615279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98f23187-3cd0-4901-b366-273314db7134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.617974 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 662/1334] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:23 2022] DELETE /identity/v3/projects/6add37c250f94fc6a2f10782acd4ad0a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:23.625143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:23.625803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:23.625803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:23.668186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:23.669438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:23.843409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 673/1335] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:23.852665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:23.852983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:23.853261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:23.899119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:23.900745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:23.927674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 663/1336] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:23.931654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:23.959729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ea77-4ce1-44d0-8e1d-71f1e362c70f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:23.977840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:23.997126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:23.997126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:23.997126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:23.997126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:23.997126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:23.997126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.030808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.031699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 674/1337] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:24.043571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47346ce-102a-4edf-b710-e9ec081e2ed7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.049194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.049837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.050118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.050461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.051105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.053441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.217827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 664/1338] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:24.221649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.235938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a4f0-1b8f-4c0e-a850-87d20f626354 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.259290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:24.336442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.337074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.337352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.341951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.342887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.345887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.517072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 675/1339] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:24.521280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.551882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e8bf6-26e0-457f-a221-8a016e8a0eed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.567300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.567989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.568564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.568742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.573084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.575688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.634963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 665/1340] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:24.635218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.685099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706364c4-2e34-44a5-9e22-5e44126c2e15 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.705749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa456-043a-4ba5-baa3-3fc9619f3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.707828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa456-043a-4ba5-baa3-3fc9619f3d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.709952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa456-043a-4ba5-baa3-3fc9619f3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.711667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa456-043a-4ba5-baa3-3fc9619f3d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.714646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa456-043a-4ba5-baa3-3fc9619f3d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.722895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa456-043a-4ba5-baa3-3fc9619f3d0a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.749801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 676/1341] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:24.754801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.775911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094ee0d-b0a8-4895-8374-77a19497d858 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.789681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.790506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.790938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.791315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] PATH_INFO: `/v3/projects/4b1ec1507c01483bb2715b8b49ea610c/users/9301b921791b4d3aaa08fde7021dd801/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.848783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1ec1507c01483bb2715b8b49ea610c, user_id=9301b921791b4d3aaa08fde7021dd801, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.859905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.968423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 666/1342] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:24 2022] PUT /identity/v3/projects/4b1ec1507c01483bb2715b8b49ea610c/users/9301b921791b4d3aaa08fde7021dd801/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:24.984757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.985072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.985627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.071700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] MFA Rules not processed for user `9301b921791b4d3aaa08fde7021dd801`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:25.083690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:25.274254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 677/1343] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:25.282572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.406033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcdfab-9cff-47dc-95a1-3b614cd6425b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.411749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.417019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.417019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.417019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.417019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.417019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.581618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 667/1344] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:25 2022] POST /identity/v3/projects => generated 365 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:25.585069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.608443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb73d-451f-4a2c-a5ee-b99890025ae9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.756972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.756972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:25.785073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.787044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.787565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.788094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.789464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.793185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.886566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6aa83-487b-4a68-9472-e8211a7b76e5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.906791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.908747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.912569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.913180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] PATH_INFO: `/v3/users/db7ac95c081043f9b0a221d5624c2a7b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.915015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7ac95c081043f9b0a221d5624c2a7b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.920322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.927925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 678/1345] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:25 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:25.934755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.956588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164138b-0a98-42f4-aa73-ee563d766559 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.965552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.965552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.965552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.965552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.966113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.968612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.982855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 679/1346] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:25.987681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.012756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a717cc-247f-4dc4-9946-308991047eec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.020585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.021714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.022085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.022533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] PATH_INFO: `/v3/projects/24496d11b5eb4558a94f01e9f2672237/users/9aa6a2b6fe1f4f6e8398d8cdd5670915/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.048658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=24496d11b5eb4558a94f01e9f2672237, user_id=9aa6a2b6fe1f4f6e8398d8cdd5670915, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.052110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.155168 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 680/1347] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:25 2022] PUT /identity/v3/projects/24496d11b5eb4558a94f01e9f2672237/users/9aa6a2b6fe1f4f6e8398d8cdd5670915/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:26.158847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.210133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7ac95c081043f9b0a221d5624c2a7b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.210983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7ac95c081043f9b0a221d5624c2a7b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.256729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7ac95c081043f9b0a221d5624c2a7b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.287769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7ac95c081043f9b0a221d5624c2a7b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.288837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3702ef48-8e61-4317-bd1c-c9c55c4316c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7ac95c081043f9b0a221d5624c2a7b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.291097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f015984-c76f-4d27-a438-3e472fee7cfc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.302296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.302990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.303275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.303551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.304209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.307110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.337232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 681/1348] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:26.337409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.339441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.362516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37889f3-f023-4c1e-bac2-1e00b9e97449 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.374764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5321a3-286a-47f7-9c98-1fb02fb14d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.381449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5321a3-286a-47f7-9c98-1fb02fb14d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.381449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5321a3-286a-47f7-9c98-1fb02fb14d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.381449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5321a3-286a-47f7-9c98-1fb02fb14d61 admin admin] PATH_INFO: `/v3/projects/24496d11b5eb4558a94f01e9f2672237/users/9aa6a2b6fe1f4f6e8398d8cdd5670915/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.384914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 668/1349] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:25 2022] DELETE /identity/v3/users/db7ac95c081043f9b0a221d5624c2a7b => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:26.389239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.389521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.390484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.395082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5321a3-286a-47f7-9c98-1fb02fb14d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24496d11b5eb4558a94f01e9f2672237, user_id=9aa6a2b6fe1f4f6e8398d8cdd5670915, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.405177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5321a3-286a-47f7-9c98-1fb02fb14d61 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.446370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:26.461154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 682/1350] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:26 2022] PUT /identity/v3/projects/24496d11b5eb4558a94f01e9f2672237/users/9aa6a2b6fe1f4f6e8398d8cdd5670915/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:26.461254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.462508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.462806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.463086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.523885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:26.562667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] MFA Rules not processed for user `9aa6a2b6fe1f4f6e8398d8cdd5670915`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:26.563905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.613125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 669/1351] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:26.624916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.627291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.765144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 683/1352] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:26.788457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.790644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.809386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2525-0da9-43b2-8e4b-15c7e2ce8c90 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.821845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.822470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.822916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.823875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.844601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.848599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.869318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 670/1353] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:26.914425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae107d-6ef8-4540-870b-551d9e434b1d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.926596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.927435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.927897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.928325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.944273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.946039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.980321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 684/1354] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:27.204052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:28.040848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:28.043220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:28.069092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a3543-ed0d-4bd4-aa85-6ca6f6c46cd1 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:28.119750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:28.119750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:28.119750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:28.119750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] PATH_INFO: `/v3/users/f95e04e3b36d4edc944881a5e4a96b81` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:28.120472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95e04e3b36d4edc944881a5e4a96b81)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:28.122322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:28.477655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95e04e3b36d4edc944881a5e4a96b81'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.478842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95e04e3b36d4edc944881a5e4a96b81'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.505039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95e04e3b36d4edc944881a5e4a96b81'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.521701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95e04e3b36d4edc944881a5e4a96b81'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.521701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95e04e3b36d4edc944881a5e4a96b81'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.591912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:28.593380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:28.618989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dba84-7425-41d3-8e33-2cf218df00ae service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:28.652581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 671/1355] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:28 2022] DELETE /identity/v3/users/f95e04e3b36d4edc944881a5e4a96b81 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:28.653171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:28.653424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:28.653867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:28.654150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:28.654432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] PATH_INFO: `/v3/projects/b2268641d1c54776a534a9285c121311` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:28.656504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2268641d1c54776a534a9285c121311)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:28.660159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:28.662040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:28.894858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2268641d1c54776a534a9285c121311', 'request_id': 'req-c883f601-dd12-4a82-b761-1bbe94b29823'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.906337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279e77-874d-4643-8221-2805d87325cd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:28.912335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2268641d1c54776a534a9285c121311', 'request_id': 'req-c883f601-dd12-4a82-b761-1bbe94b29823'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.994201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2268641d1c54776a534a9285c121311', 'request_id': 'req-c883f601-dd12-4a82-b761-1bbe94b29823'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.018362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] The token cache is being invalidate because project b2268641d1c54776a534a9285c121311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:29.018718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.019603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c883f601-dd12-4a82-b761-1bbe94b29823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.021430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 685/1356] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:28 2022] DELETE /identity/v3/projects/b2268641d1c54776a534a9285c121311 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:29.022942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.023424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.023701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.092795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:29.094182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.117997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:29.118170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:29.118170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.118170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.118170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] PATH_INFO: `/v3/users/a4c7afb29947409987144dc5038a679f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.122677 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c7afb29947409987144dc5038a679f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:29.133148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 686/1357] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:29.134926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:29.138586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:29.140461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.178551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be5d52-a865-4228-9bfb-f7c4a41c4dad None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:29.194289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:29.199124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.203332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.203332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] PATH_INFO: `/v3/users/9301b921791b4d3aaa08fde7021dd801` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.210465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9301b921791b4d3aaa08fde7021dd801)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:29.212697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:29.283166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:29.441941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c7afb29947409987144dc5038a679f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.442969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c7afb29947409987144dc5038a679f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.443377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9301b921791b4d3aaa08fde7021dd801'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.444087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9301b921791b4d3aaa08fde7021dd801'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.540500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c7afb29947409987144dc5038a679f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.542640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9301b921791b4d3aaa08fde7021dd801'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.551378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c7afb29947409987144dc5038a679f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.552937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c7afb29947409987144dc5038a679f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.643820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9301b921791b4d3aaa08fde7021dd801'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.652916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-bc42c195-f88b-4b52-98f0-56b274fe7e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9301b921791b4d3aaa08fde7021dd801'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.684192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 687/1358] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:29 2022] DELETE /identity/v3/users/9301b921791b4d3aaa08fde7021dd801 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:29.686107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6087-ce4d-4fd1-a14e-e40c0fc780e3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.686729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6087-ce4d-4fd1-a14e-e40c0fc780e3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.688000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6087-ce4d-4fd1-a14e-e40c0fc780e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.711094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 672/1359] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:28 2022] DELETE /identity/v3/users/a4c7afb29947409987144dc5038a679f => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:29.711094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:29.712031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.720071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-abda6087-ce4d-4fd1-a14e-e40c0fc780e3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:29.721727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abda6087-ce4d-4fd1-a14e-e40c0fc780e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.820464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5388b1-66b4-4cd4-9fe5-dfc3148ac388 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:29.830450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 688/1360] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:29.831931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:29.832640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.832762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.833049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.833392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.833710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.834183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.835953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.862905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:29.870612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b9077-0ebc-4e0e-b3f5-cf0ea6f9cce5 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:29.883873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] MFA Rules not processed for user `429fa7f2640a4b8d9e9ad48002bf2425`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:29.886833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.893067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 673/1361] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:29.894608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aabcbf-ae52-48a8-b473-33c6197bfb65 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.894989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aabcbf-ae52-48a8-b473-33c6197bfb65 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.895219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aabcbf-ae52-48a8-b473-33c6197bfb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.924912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-77aabcbf-ae52-48a8-b473-33c6197bfb65 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:29.926145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77aabcbf-ae52-48a8-b473-33c6197bfb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.938013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 674/1362] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:29.939300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b647-3ec5-4053-8f04-5f34a10f5f0b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.940567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b647-3ec5-4053-8f04-5f34a10f5f0b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.940780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b647-3ec5-4053-8f04-5f34a10f5f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.984977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1926b647-3ec5-4053-8f04-5f34a10f5f0b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:29.986263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1926b647-3ec5-4053-8f04-5f34a10f5f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.002945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 675/1363] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.003961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.004251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.004525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.040946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 689/1364] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.041873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.044657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.054967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:30.063369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.072057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6f47e-d58e-4148-8026-28ece077bbec None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.087607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d50e0-4ce8-4fdf-bded-5e832e26297d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.088521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d50e0-4ce8-4fdf-bded-5e832e26297d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.089343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d50e0-4ce8-4fdf-bded-5e832e26297d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.089660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d50e0-4ce8-4fdf-bded-5e832e26297d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.093746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 676/1365] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.096269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.118900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d50e0-4ce8-4fdf-bded-5e832e26297d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.121909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d50e0-4ce8-4fdf-bded-5e832e26297d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.123116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb85f-1ed0-49be-9647-f765a52ab8a0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.145598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.147529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.150039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.152067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.153881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 690/1366] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:30.154412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.154696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.154975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.180122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.193983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.211601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] MFA Rules not processed for user `429fa7f2640a4b8d9e9ad48002bf2425`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:30.238110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.264577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 677/1367] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:30.264730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.292643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 691/1368] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.325020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.326663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.331451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2c57-3203-455f-acdc-e3c6634a005d service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.352750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.353462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.353949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.355324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.356206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:30.356703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.358704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.382260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 678/1369] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:30.385730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.410222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7899c-5902-4f8c-b673-fcd7143ebc57 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.430149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.430996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.431448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.431902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.432753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.434901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.563695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0ea9-9e71-4947-9cb3-717e04404473 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.580764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 679/1370] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/projects => generated 407 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:30.585448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.596347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.596992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.597307 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.597978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.623641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.629787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.671849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 692/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:30.740402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:30.797899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79935b93-0147-461b-9330-a3c0f0d263ca admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.808582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.809342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.821982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.821982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.821982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.821982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.958217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 680/1372] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/users => generated 304 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:30.962849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.980785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca1583-3aa0-4b68-ba4b-1f39cde8b456 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.993683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.997521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.998055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.999040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.000177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.004382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.039978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 693/1373] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:31.041573 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:31.058801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff309e-4074-458c-9ece-c64d2592948e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.074010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656568-93a2-4cb1-a982-279146eb8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.074715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656568-93a2-4cb1-a982-279146eb8dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.075141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656568-93a2-4cb1-a982-279146eb8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.075445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656568-93a2-4cb1-a982-279146eb8dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.077990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656568-93a2-4cb1-a982-279146eb8dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.095100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656568-93a2-4cb1-a982-279146eb8dcf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.130831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 681/1374] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:31.134732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:31.150512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa4fec-1ee5-4828-b9df-efb56108b759 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.164524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.165184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.166646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.166966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] PATH_INFO: `/v3/projects/f9fd508a020146ea80760c839db11d08/users/7b72ce7db89641b2a0cc705162e01ab2/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.205067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fd508a020146ea80760c839db11d08, user_id=7b72ce7db89641b2a0cc705162e01ab2, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.213595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.317581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 694/1375] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:31 2022] PUT /identity/v3/projects/f9fd508a020146ea80760c839db11d08/users/7b72ce7db89641b2a0cc705162e01ab2/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:31.330127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.330127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.330341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.380230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] MFA Rules not processed for user `7b72ce7db89641b2a0cc705162e01ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:31.380230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:31.554405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 682/1376] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:31 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:31.558630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:31.563962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:31.814227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e6a4-f538-489f-a565-770cdf45857c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.814227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ca40-8069-4beb-960f-32308232b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.814227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ca40-8069-4beb-960f-32308232b8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.814227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ca40-8069-4beb-960f-32308232b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.819001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ca40-8069-4beb-960f-32308232b8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.819001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ca40-8069-4beb-960f-32308232b8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.819001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ca40-8069-4beb-960f-32308232b8d0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.820509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:31.820509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:31.820509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fb426-e956-400c-8b50-de074c7d4cb8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.853971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.853971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.853971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.853971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] PATH_INFO: `/v3/projects/4b1ec1507c01483bb2715b8b49ea610c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.855400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1ec1507c01483bb2715b8b49ea610c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.855400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:32.016406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 695/1377] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:31 2022] POST /identity/v3/projects => generated 407 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:32.025568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b85b-f17d-429a-9d31-3094d0020709 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:32.025568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b85b-f17d-429a-9d31-3094d0020709 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:32.025568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b85b-f17d-429a-9d31-3094d0020709 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:32.025568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 696/1378] 10.222.0.26 () {54 vars in 912 bytes} [Wed Nov 2 07:43:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:32.029305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b85b-f17d-429a-9d31-3094d0020709 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:32.086299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1ec1507c01483bb2715b8b49ea610c', 'request_id': 'req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.099622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1ec1507c01483bb2715b8b49ea610c', 'request_id': 'req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.192466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1ec1507c01483bb2715b8b49ea610c', 'request_id': 'req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.229931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] The token cache is being invalidate because project 4b1ec1507c01483bb2715b8b49ea610c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:32.236164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b85b-f17d-429a-9d31-3094d0020709 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:32.236932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.239142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2d195dce-3f4c-47e8-b6ca-d69de2720fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.248858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 683/1379] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:31 2022] DELETE /identity/v3/projects/4b1ec1507c01483bb2715b8b49ea610c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:32.250692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:32.268242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:32.268242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:32.349606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] MFA Rules not processed for user `94d217e156e944c3ba7dbbab90344e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:32.351061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:32.359683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:32.360502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:32.361085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:32.361413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:32.362102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:32.365816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:32.432007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 684/1380] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:32.433831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:32.435830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:32.462193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53342f5b-9b09-46d6-a662-d45b62534f22 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:32.474379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:32.475388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:32.475870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:32.477220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] PATH_INFO: `/v3/projects/e278a2c2980d4a60bdde8108a8b9686f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:32.478924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e278a2c2980d4a60bdde8108a8b9686f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:32.482335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:32.502185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 697/1381] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:32 2022] POST /identity/v3/users => generated 310 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:32.503383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:32.508502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:32.540586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd37cf9-a56c-491b-8643-62ef4675ee83 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:32.551337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:32.551992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:32.552261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:32.552534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] PATH_INFO: `/v3/projects/a392f0c9edd24290bd66eb29f9679688` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:32.553709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a392f0c9edd24290bd66eb29f9679688)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:32.557015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:32.696746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a392f0c9edd24290bd66eb29f9679688', 'request_id': 'req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.707313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a392f0c9edd24290bd66eb29f9679688', 'request_id': 'req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.717444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e278a2c2980d4a60bdde8108a8b9686f', 'request_id': 'req-82564da1-6ddb-4d7b-a8ef-ffac172d97be'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.730526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e278a2c2980d4a60bdde8108a8b9686f', 'request_id': 'req-82564da1-6ddb-4d7b-a8ef-ffac172d97be'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.799902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a392f0c9edd24290bd66eb29f9679688', 'request_id': 'req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.826334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] The token cache is being invalidate because project a392f0c9edd24290bd66eb29f9679688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:32.826973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.827624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.830233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 698/1382] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:32 2022] DELETE /identity/v3/projects/a392f0c9edd24290bd66eb29f9679688 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:32.832496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:32.833025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:32.881732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e278a2c2980d4a60bdde8108a8b9686f', 'request_id': 'req-82564da1-6ddb-4d7b-a8ef-ffac172d97be'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.898484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] The token cache is being invalidate because project e278a2c2980d4a60bdde8108a8b9686f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:32.899230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.899553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:32.904873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 685/1383] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:32 2022] DELETE /identity/v3/projects/e278a2c2980d4a60bdde8108a8b9686f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:32.906216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:32.909029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:32.983235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc79e3-cc9f-4494-9c2d-2e715ca600f6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:33.001175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564da1-6ddb-4d7b-a8ef-ffac172d97be admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:33.007292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:33.008482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.008765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.009627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.012659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.026659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:33.027097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:33.033630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:33.098356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:33.098813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.098949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 686/1384] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:33.099719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.100074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] PATH_INFO: `/v3/users/9aa6a2b6fe1f4f6e8398d8cdd5670915` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.100613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:33.101990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa6a2b6fe1f4f6e8398d8cdd5670915)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:33.105408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:33.105675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.137292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93640a5-6434-4689-ab6e-3c50c96861d2 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:33.148412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55243db-690c-47cb-b579-6cb7567f9c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:33.149867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55243db-690c-47cb-b579-6cb7567f9c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.149867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55243db-690c-47cb-b579-6cb7567f9c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.149867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55243db-690c-47cb-b579-6cb7567f9c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.151824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55243db-690c-47cb-b579-6cb7567f9c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:33.153870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55243db-690c-47cb-b579-6cb7567f9c3f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:33.185047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 687/1385] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:33.193567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.194161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.195379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.226691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:33.231310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.252114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 688/1386] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:33.253091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:33.256047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.283354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d505c-f293-4897-bb1d-5140b3f11b61 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:33.294027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:33.295688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.295981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.296255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] PATH_INFO: `/v3/users/460e529238ae4badbe9737b301e0ff19` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.297427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460e529238ae4badbe9737b301e0ff19)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:33.300197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:33.336982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa6a2b6fe1f4f6e8398d8cdd5670915'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.338576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa6a2b6fe1f4f6e8398d8cdd5670915'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.371655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa6a2b6fe1f4f6e8398d8cdd5670915'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.502657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa6a2b6fe1f4f6e8398d8cdd5670915'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.507089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79779f9f-3828-4df1-ab7b-26e9224812c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa6a2b6fe1f4f6e8398d8cdd5670915'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.520744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 699/1387] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:32 2022] DELETE /identity/v3/users/9aa6a2b6fe1f4f6e8398d8cdd5670915 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:33.522424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.522778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.533944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.593396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460e529238ae4badbe9737b301e0ff19'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.597337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460e529238ae4badbe9737b301e0ff19'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.637199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460e529238ae4badbe9737b301e0ff19'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.643330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] MFA Rules not processed for user `a881b31e78e7433bb3eab1608884ae1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:33.645460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.654414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460e529238ae4badbe9737b301e0ff19'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.656297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f670febe-0f17-4e33-b812-8a5ee3429d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460e529238ae4badbe9737b301e0ff19'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:33.757402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 689/1388] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:33 2022] DELETE /identity/v3/users/460e529238ae4badbe9737b301e0ff19 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:33.758972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934e72-92db-442d-9357-2e8bc58ceb72 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:33.759306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934e72-92db-442d-9357-2e8bc58ceb72 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:33.759674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934e72-92db-442d-9357-2e8bc58ceb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:33.829258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 700/1389] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:33.830738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:33.835705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.877376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-59934e72-92db-442d-9357-2e8bc58ceb72 None None] MFA Rules not processed for user `33ef03ba2d8c43d6a745490b9ea2afdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:33.880306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-59934e72-92db-442d-9357-2e8bc58ceb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:33.964518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:34.009836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc81d0-db62-4c43-97fe-fddf2570fccd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:34.142225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:34.143628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.144313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.145991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] PATH_INFO: `/v3/projects/4726cd4e1d3343a29f7d34cdadb843c5/users/9e05af1281e04151ae8e13245c5abe44/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.191973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4726cd4e1d3343a29f7d34cdadb843c5, user_id=9e05af1281e04151ae8e13245c5abe44, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:34.198709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:34.213852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 690/1390] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:34.213852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.213852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.213852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.279367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:34.280890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.291147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 691/1391] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:34.302215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:34.302215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.320959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeee80-ae97-47e7-bef4-c26c6a52867a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:34.331101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 701/1392] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:33 2022] PUT /identity/v3/projects/4726cd4e1d3343a29f7d34cdadb843c5/users/9e05af1281e04151ae8e13245c5abe44/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:34.335043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:34.335978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.341054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:34.342073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.342350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.342617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] PATH_INFO: `/v3/users/d906a82c15bb400390784907a53a3652` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.349066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d906a82c15bb400390784907a53a3652)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:34.353688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:34.488852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9501d-2552-4319-832b-d1ee41417539 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:34.499253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:34.500087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.500372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.500794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.608368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:34.610288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:34.640842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 702/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:34.655133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:34.661058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.684288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd906a82c15bb400390784907a53a3652'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:34.686294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd906a82c15bb400390784907a53a3652'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:34.727493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd906a82c15bb400390784907a53a3652'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:34.729832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:34.758973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd906a82c15bb400390784907a53a3652'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:34.761500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-69e52ddb-d60d-4645-92e9-3c4b8daa095d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd906a82c15bb400390784907a53a3652'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:34.841417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eedbf1-c3a6-4531-93f8-616c96df89ee service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:34.847397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:34.848026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.848631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.849000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.851351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.864302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:34.866287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd986de-764e-4fbb-be6c-e5d60935cf57 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:34.875823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 692/1394] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:34 2022] DELETE /identity/v3/users/d906a82c15bb400390784907a53a3652 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:34.880273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.880273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.880273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.880521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 703/1395] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:34.881309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:34.881771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:34.882144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:34.904082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] MFA Rules not processed for user `33ef03ba2d8c43d6a745490b9ea2afdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:34.906325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.927845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] MFA Rules not processed for user `429fa7f2640a4b8d9e9ad48002bf2425`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:34.929115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:34.993182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 704/1396] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:35.000041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:35.002255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.057384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 693/1397] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:35.057384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:35.060307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.143915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4901ebc-4c5d-4fed-8003-67b62cd69d66 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:35.155161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:35.155997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.157594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.159379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:35.160344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:35.161051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:35.164530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:35.192598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 705/1398] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:35.196325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:35.200071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.219641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d62aa-a5fe-41ee-ac64-90bbdaf0758e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:35.233785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cb23e-47db-4872-acb2-9d102c81633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:35.235778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb23e-47db-4872-acb2-9d102c81633e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.239806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb23e-47db-4872-acb2-9d102c81633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.242590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb23e-47db-4872-acb2-9d102c81633e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:35.243068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb133-5c1a-4b2a-806a-a9d5a2cc01a9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:35.243749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cb23e-47db-4872-acb2-9d102c81633e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:35.253076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cb23e-47db-4872-acb2-9d102c81633e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:35.258658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:35.259320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.259652 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.260317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] PATH_INFO: `/v3/projects/24496d11b5eb4558a94f01e9f2672237` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:35.262453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=24496d11b5eb4558a94f01e9f2672237)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:35.264503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:35.290414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 694/1399] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:35.295492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.297665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.298299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:35.358460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:35.359735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.389936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 695/1400] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:35.403297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:35.408290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.437960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1591b-e6ca-4cc4-a75d-f8f1d55b974e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:35.453846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:35.454838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.455284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.455622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] PATH_INFO: `/v3/projects/49aad0518fe24d3db1f7781e412b6bde` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:35.461994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49aad0518fe24d3db1f7781e412b6bde)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:35.466532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:35.468737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24496d11b5eb4558a94f01e9f2672237', 'request_id': 'req-3ac63d28-3df7-4e6f-8899-110bb00960ee'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.483914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24496d11b5eb4558a94f01e9f2672237', 'request_id': 'req-3ac63d28-3df7-4e6f-8899-110bb00960ee'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.555323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24496d11b5eb4558a94f01e9f2672237', 'request_id': 'req-3ac63d28-3df7-4e6f-8899-110bb00960ee'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.581154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] The token cache is being invalidate because project 24496d11b5eb4558a94f01e9f2672237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:35.587800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.593254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.594407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 706/1401] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:35 2022] DELETE /identity/v3/projects/24496d11b5eb4558a94f01e9f2672237 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:35.595349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:35.597088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.680392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49aad0518fe24d3db1f7781e412b6bde', 'request_id': 'req-fd44d267-6260-4c37-bc49-35518764a869'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.691870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49aad0518fe24d3db1f7781e412b6bde', 'request_id': 'req-fd44d267-6260-4c37-bc49-35518764a869'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.768599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac63d28-3df7-4e6f-8899-110bb00960ee admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:35.772723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49aad0518fe24d3db1f7781e412b6bde', 'request_id': 'req-fd44d267-6260-4c37-bc49-35518764a869'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.792948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] The token cache is being invalidate because project 49aad0518fe24d3db1f7781e412b6bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:35.794881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.795175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:35.811299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 696/1402] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:35 2022] DELETE /identity/v3/projects/49aad0518fe24d3db1f7781e412b6bde => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:35.811299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:35.814307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:35.906951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44d267-6260-4c37-bc49-35518764a869 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:35.912294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:35.913052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.913348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.913786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:35.914600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:35.917610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:35.997956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:35.998622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:35.998879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:35.999272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.012082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.054377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 697/1403] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:36.054377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:36.057225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.130519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:36.132255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:36.150487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 707/1404] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:36.152093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:36.154039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.216157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03af86-589f-4b8a-9039-61699bc47714 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:36.228795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d494bb-54e6-4316-b47b-45fdfc66dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:36.229845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d494bb-54e6-4316-b47b-45fdfc66dc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.230243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d494bb-54e6-4316-b47b-45fdfc66dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.230827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d494bb-54e6-4316-b47b-45fdfc66dc2b admin admin] PATH_INFO: `/v3/projects/4726cd4e1d3343a29f7d34cdadb843c5/users/9e05af1281e04151ae8e13245c5abe44/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.240799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d494bb-54e6-4316-b47b-45fdfc66dc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4726cd4e1d3343a29f7d34cdadb843c5, user_id=9e05af1281e04151ae8e13245c5abe44, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:36.246824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d494bb-54e6-4316-b47b-45fdfc66dc2b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:36.270475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 698/1405] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:36 2022] PUT /identity/v3/projects/4726cd4e1d3343a29f7d34cdadb843c5/users/9e05af1281e04151ae8e13245c5abe44/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:36.273450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb61b-e50c-470c-832f-788dc1977b05 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.274840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb61b-e50c-470c-832f-788dc1977b05 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.274840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb61b-e50c-470c-832f-788dc1977b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.298815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71ab9-2aae-4ed5-8b0c-ddb19c3fc59f service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:36.324176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-82dfb61b-e50c-470c-832f-788dc1977b05 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:36.326597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82dfb61b-e50c-470c-832f-788dc1977b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.449604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:36.450712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.451137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.451588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.454064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.514229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 699/1406] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:36.516389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa0d5-b08d-456b-9644-b5f4950a86b2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.516884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa0d5-b08d-456b-9644-b5f4950a86b2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.517261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa0d5-b08d-456b-9644-b5f4950a86b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.592659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2b7aa0d5-b08d-456b-9644-b5f4950a86b2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:36.595909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2b7aa0d5-b08d-456b-9644-b5f4950a86b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.600706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:36.611261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:36.628452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 708/1407] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:36.628967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 700/1408] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:36.630354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:36.630660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f232-d609-418e-9266-03a1cc0674a4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.631053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f232-d609-418e-9266-03a1cc0674a4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.631441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f232-d609-418e-9266-03a1cc0674a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.647348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee20da-9df7-4937-b7ed-6fbf52571a02 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:36.654406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2100e3-fb1a-4767-8fd0-77723bacf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:36.655674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2100e3-fb1a-4767-8fd0-77723bacf0db admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.656366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2100e3-fb1a-4767-8fd0-77723bacf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.656792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2100e3-fb1a-4767-8fd0-77723bacf0db admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.657646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2100e3-fb1a-4767-8fd0-77723bacf0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:36.674067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:36.679704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2100e3-fb1a-4767-8fd0-77723bacf0db admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:36.696896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0527f232-d609-418e-9266-03a1cc0674a4 None None] MFA Rules not processed for user `9e05af1281e04151ae8e13245c5abe44`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:36.703433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0527f232-d609-418e-9266-03a1cc0674a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.741574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:36.779420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 709/1409] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:36 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:36.781404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.781833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.782998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.850853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:36.852311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.853100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 701/1410] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:36.856171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.860773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.870376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.882009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 710/1411] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:36.883457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:36.895930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43fdc5-70a2-4ac6-88ea-7924b1d15b67 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:36.904226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:36.905461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.906438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.906956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.908101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:36.910851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:36.911989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:36.913225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.922981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 702/1412] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:36.923943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:36.925420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:36.935702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 711/1413] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:36.935702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:36.946417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27358e-8e66-4ac9-8116-c86f951576c7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:36.970562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:36.972888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:36.973279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:36.973695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:36.977214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:36.978679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:36.983204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.069057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294025dd-ec4a-4139-bdbd-101df488fe79 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.073570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77d952-d760-4665-b9a8-0fe37da1d1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.074178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77d952-d760-4665-b9a8-0fe37da1d1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.074518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77d952-d760-4665-b9a8-0fe37da1d1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.074795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77d952-d760-4665-b9a8-0fe37da1d1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.088959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77d952-d760-4665-b9a8-0fe37da1d1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.091122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77d952-d760-4665-b9a8-0fe37da1d1c9 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.119420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 703/1414] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:36 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:37.122570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ef99-ea8e-4bb8-8034-d8dc48a5e6d2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.125781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ef99-ea8e-4bb8-8034-d8dc48a5e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.125781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ef99-ea8e-4bb8-8034-d8dc48a5e6d2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.142146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 704/1415] 10.222.0.26 () {54 vars in 912 bytes} [Wed Nov 2 07:43:37 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:37.148339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579ef99-ea8e-4bb8-8034-d8dc48a5e6d2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.178431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 712/1416] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:37.179565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.187671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579ef99-ea8e-4bb8-8034-d8dc48a5e6d2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.196488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6203a2e-90c5-49c2-8f1c-2f27fdb992ab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.202744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b09ee-342f-4fe0-b78d-05925c314e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.203481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b09ee-342f-4fe0-b78d-05925c314e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.203854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b09ee-342f-4fe0-b78d-05925c314e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.204377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.204539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b09ee-342f-4fe0-b78d-05925c314e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.205000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.205383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b09ee-342f-4fe0-b78d-05925c314e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.205491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.205739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.206391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:37.206739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.217994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.233225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b09ee-342f-4fe0-b78d-05925c314e10 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.273192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 713/1417] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:37.274737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.276312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.276312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.298050 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 705/1418] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:37.305311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.311431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b81cdc-4c24-48e9-ba44-b8baf11c7a77 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.318529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.319568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.320135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.320555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.321340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.324009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.361212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] MFA Rules not processed for user `94d217e156e944c3ba7dbbab90344e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:37.364000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:37.374944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 714/1419] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:37.375526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.391662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bd017-89a8-4f3f-8291-18192999de78 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.395817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.397101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.397602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.397983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] PATH_INFO: `/v3/projects/9ce5922179d341dcb3375391138aaf6d/users/8a379a5cb7c3402ca5a0dbc6c0d2cf67/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.421902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 706/1420] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:37 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:37.423311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.431064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce5922179d341dcb3375391138aaf6d, user_id=8a379a5cb7c3402ca5a0dbc6c0d2cf67, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.434155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.596563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 715/1421] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:37 2022] PUT /identity/v3/projects/9ce5922179d341dcb3375391138aaf6d/users/8a379a5cb7c3402ca5a0dbc6c0d2cf67/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:37.609737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.618872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c5ea-9de2-4535-b230-4e0a76d08297 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.772091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3941269-69f0-4f5b-bcda-e7e7eab75e16 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.799258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.799885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.800163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.800433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.801070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.803206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.818707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9af34-d1cc-4023-8b83-62c5ce02376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.819736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9af34-d1cc-4023-8b83-62c5ce02376f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.820348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9af34-d1cc-4023-8b83-62c5ce02376f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.821605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9af34-d1cc-4023-8b83-62c5ce02376f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.824139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9af34-d1cc-4023-8b83-62c5ce02376f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.828140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9af34-d1cc-4023-8b83-62c5ce02376f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.933499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 716/1422] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:37 2022] POST /identity/v3/users => generated 279 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:37.936403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.939924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:37.998973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 707/1423] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:37 2022] POST /identity/v3/projects => generated 385 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:38.000185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.001114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.001394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.048584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] MFA Rules not processed for user `8a379a5cb7c3402ca5a0dbc6c0d2cf67`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:38.050062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.062598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc473c7-06ca-4858-b8a6-6b76b51d25da admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.148703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.152119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.152119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.152119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.158492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.160189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.168342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 708/1424] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:38.168342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.168978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.170814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 717/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:38.171515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.302005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030638c-0905-46bb-a27b-a0bd1e3c68ac None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.307466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663160-79ae-4413-b2d2-476512dbfee5 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.313035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.315087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.315252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.319376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.321091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.321855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.326449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.326449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] PATH_INFO: `/v3/projects/d18554e041ba4f9999b1d9763bf67ff0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.326862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.326942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18554e041ba4f9999b1d9763bf67ff0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.327946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.456156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.480766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.488534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18554e041ba4f9999b1d9763bf67ff0', 'request_id': 'req-939e7a9f-b1a2-4490-a2ee-729c5040382a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.493906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 718/1426] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:38 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:38.496284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.504125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18554e041ba4f9999b1d9763bf67ff0', 'request_id': 'req-939e7a9f-b1a2-4490-a2ee-729c5040382a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.515660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade156-bf7e-4347-b3ea-1aaa7b5ce032 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.583805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18554e041ba4f9999b1d9763bf67ff0', 'request_id': 'req-939e7a9f-b1a2-4490-a2ee-729c5040382a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.610348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] The token cache is being invalidate because project d18554e041ba4f9999b1d9763bf67ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:38.610660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.619933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.628345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 709/1427] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:38 2022] DELETE /identity/v3/projects/d18554e041ba4f9999b1d9763bf67ff0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:38.629187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.635617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.660744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.661469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.661773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.662046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.664877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.669324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.696336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 719/1428] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:38.699845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.707452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.739579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e19ad-e733-4eb6-81a1-6b19ddef2e20 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.754874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.755518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.755789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.756064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.756798 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.758744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.770140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e7a9f-b1a2-4490-a2ee-729c5040382a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.785888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.785888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.785888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.786196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.786923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.788993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.888416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 720/1429] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:38 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:38.889290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.895404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.956245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 710/1430] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:38 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:38.957448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.959721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.979467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc465-4232-4751-a321-6b383dd7a1ad admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.005587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072af95f-886e-445a-9d34-edb50013b7d9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.012342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.013149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.013428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.013776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] PATH_INFO: `/v3/users/bbc2958591714fad971419c150c1ef58` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.014948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc2958591714fad971419c150c1ef58)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.016958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.050823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.051785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.052084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.052346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.053710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.055473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.068441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 711/1431] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:39.069221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.086498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa31294-2080-4234-8fc0-ede8603494c5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.093019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.093752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.094133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.094496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.095331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.097364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.222912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:39.223158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 712/1432] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:39.223158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.238614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a123c1-1973-4a41-859b-71d0e2178f65 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.244900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.246769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.247652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.248092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.248914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.250933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.279737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc2958591714fad971419c150c1ef58'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.280453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc2958591714fad971419c150c1ef58'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.286844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 713/1433] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:39.287822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.291247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.313573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc2958591714fad971419c150c1ef58'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.356978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af554-7bc5-459d-86bc-adaa1182d364 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.378001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.379203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.380315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.380620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] PATH_INFO: `/v3/projects/b5fc0789abb6446da451b8130d838e9b/users/d972e042143542ef840fd53f8f70b4f6/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.411709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc2958591714fad971419c150c1ef58'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.412617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:39.417100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fc0789abb6446da451b8130d838e9b, user_id=d972e042143542ef840fd53f8f70b4f6, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.421012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.425066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc2958591714fad971419c150c1ef58'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.443963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 721/1434] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:38 2022] DELETE /identity/v3/users/bbc2958591714fad971419c150c1ef58 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:39.449793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.449793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.577914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 714/1435] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:39 2022] PUT /identity/v3/projects/b5fc0789abb6446da451b8130d838e9b/users/d972e042143542ef840fd53f8f70b4f6/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:39.578938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.588766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.630542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b89635-51cb-4bc8-b176-75ef3df12024 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.714660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2b943-5a00-4386-b330-6791b0572241 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.719672 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa7e5-b617-49dd-b7c4-bb0c98e79fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.720311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa7e5-b617-49dd-b7c4-bb0c98e79fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.720588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa7e5-b617-49dd-b7c4-bb0c98e79fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.720719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.720895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa7e5-b617-49dd-b7c4-bb0c98e79fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.721744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.721856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa7e5-b617-49dd-b7c4-bb0c98e79fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.722324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.722746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.723416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa7e5-b617-49dd-b7c4-bb0c98e79fdc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.723767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.726077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.736953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 715/1436] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:39.738360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.738642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.738917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.750914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 722/1437] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:39.752898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.771204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22d29-520d-43d1-8c1a-af1ce43420aa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.787604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ce26-3287-4a43-a657-1257eb673b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.788451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce26-3287-4a43-a657-1257eb673b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.788736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce26-3287-4a43-a657-1257eb673b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.789005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce26-3287-4a43-a657-1257eb673b84 admin admin] PATH_INFO: `/v3/projects/6db7bddfb3ab49669fd2a71a9c46821a/users/c102ea6ef16440d18191a257c33f12b9/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.801931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] MFA Rules not processed for user `d972e042143542ef840fd53f8f70b4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:39.803756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.810342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382ce26-3287-4a43-a657-1257eb673b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db7bddfb3ab49669fd2a71a9c46821a, user_id=c102ea6ef16440d18191a257c33f12b9, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.819707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382ce26-3287-4a43-a657-1257eb673b84 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.888565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 716/1438] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:39.889739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.918322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 723/1439] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:39 2022] PUT /identity/v3/projects/6db7bddfb3ab49669fd2a71a9c46821a/users/c102ea6ef16440d18191a257c33f12b9/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:39.921821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.922114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.922422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.926164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8521-388d-46c6-96b8-2ee39d3d38fb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.982090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] MFA Rules not processed for user `a881b31e78e7433bb3eab1608884ae1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:39.986514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.027996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ba9a-de9c-4359-8828-c8253e3e512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.027996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ba9a-de9c-4359-8828-c8253e3e512e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.027996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ba9a-de9c-4359-8828-c8253e3e512e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.027996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ba9a-de9c-4359-8828-c8253e3e512e admin admin] PATH_INFO: `/v3/projects/016cf52d29ec4046a6d769896779a3c0/users/9ca0d1f3bd94473da3a0aab2888e919e/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.060084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ba9a-de9c-4359-8828-c8253e3e512e admin admin] RBAC: Authorizing `identity:create_grant(project_id=016cf52d29ec4046a6d769896779a3c0, user_id=9ca0d1f3bd94473da3a0aab2888e919e, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.080568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ba9a-de9c-4359-8828-c8253e3e512e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.082145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 724/1440] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:40.083315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.131977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17fe51-7b0a-4273-acfa-3759590806d6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.148514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.149149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.149427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.149725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.159713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.163193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.199869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 717/1441] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:39 2022] PUT /identity/v3/projects/016cf52d29ec4046a6d769896779a3c0/users/9ca0d1f3bd94473da3a0aab2888e919e/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:40.201045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469c3e8-bf83-47ec-94f4-7e7a7281b3ee None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.202392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469c3e8-bf83-47ec-94f4-7e7a7281b3ee None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.203009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469c3e8-bf83-47ec-94f4-7e7a7281b3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.250604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8469c3e8-bf83-47ec-94f4-7e7a7281b3ee None None] MFA Rules not processed for user `c102ea6ef16440d18191a257c33f12b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:40.252730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8469c3e8-bf83-47ec-94f4-7e7a7281b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.309062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 725/1442] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:40 2022] POST /identity/v3/projects => generated 355 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:40.310051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.311718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.442467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 718/1443] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:40.442467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.442467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.442467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.457860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464abc9-61cb-41e4-9c47-0fcd27511a31 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.459707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:40.462446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.465163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.465861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.466143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.466418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] PATH_INFO: `/v3/projects/d76efe52ba9146c582bbf06e5878b024` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.468629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76efe52ba9146c582bbf06e5878b024)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.470068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.571072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 719/1444] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:40.584992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.610795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bf969-c20c-41b6-8cd7-70e019298e06 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.623705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.624286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.624596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.625010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.625721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.627626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.640007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 720/1445] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:40.641961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.655038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40820020-160a-4084-9c81-992290f21b72 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.660875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.661820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.662103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.662376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.663022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.665333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.763419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76efe52ba9146c582bbf06e5878b024', 'request_id': 'req-918688e1-849f-45fa-afb6-51baab0af6b8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:40.778867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76efe52ba9146c582bbf06e5878b024', 'request_id': 'req-918688e1-849f-45fa-afb6-51baab0af6b8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:40.788095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 721/1446] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:40 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:40.792230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.804344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ca1c-c7e6-45b4-80d1-7e4df72cdc2c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.848808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76efe52ba9146c582bbf06e5878b024', 'request_id': 'req-918688e1-849f-45fa-afb6-51baab0af6b8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:40.861848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] The token cache is being invalidate because project d76efe52ba9146c582bbf06e5878b024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:40.862102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:40.862781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:40.865931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 726/1447] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:40 2022] DELETE /identity/v3/projects/d76efe52ba9146c582bbf06e5878b024 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:40.866764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.880482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.882882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba9517-3f13-4056-b26f-69520912a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.883498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9517-3f13-4056-b26f-69520912a83e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.883783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9517-3f13-4056-b26f-69520912a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.884061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9517-3f13-4056-b26f-69520912a83e admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.885247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba9517-3f13-4056-b26f-69520912a83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.887393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba9517-3f13-4056-b26f-69520912a83e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.954293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918688e1-849f-45fa-afb6-51baab0af6b8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.958941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.959684 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.961616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.961616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] PATH_INFO: `/v3/projects/016cf52d29ec4046a6d769896779a3c0/users/9ca0d1f3bd94473da3a0aab2888e919e/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.963093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=016cf52d29ec4046a6d769896779a3c0, user_id=9ca0d1f3bd94473da3a0aab2888e919e, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.965845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.978967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 727/1448] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:40 2022] PUT /identity/v3/projects/016cf52d29ec4046a6d769896779a3c0/users/9ca0d1f3bd94473da3a0aab2888e919e/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:40.980098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.982210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.053063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 722/1449] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:40 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:41.054574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ce0ab-519d-4823-9b83-367d9baf4092 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.054862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ce0ab-519d-4823-9b83-367d9baf4092 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.055134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ce0ab-519d-4823-9b83-367d9baf4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.078730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4f4ce0ab-519d-4823-9b83-367d9baf4092 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:41.080099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4f4ce0ab-519d-4823-9b83-367d9baf4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.089517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca9e8d-9c1f-4d64-87f9-aae0466fc0ae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.178781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.179962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.180244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.180695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.181746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.183823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.196323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 723/1450] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:41.198536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 728/1451] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:41.199567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.199836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.200881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.201163 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.214551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.238022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] MFA Rules not processed for user `9ca0d1f3bd94473da3a0aab2888e919e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:41.239430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.333393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 724/1452] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:41.334282 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.335859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.353736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f87b1-c095-425d-bb11-150ac80cce26 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.361412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dd17e-258e-41cf-a8b6-528e55321f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.362186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd17e-258e-41cf-a8b6-528e55321f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.362477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd17e-258e-41cf-a8b6-528e55321f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.362741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd17e-258e-41cf-a8b6-528e55321f29 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.363380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dd17e-258e-41cf-a8b6-528e55321f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.366260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dd17e-258e-41cf-a8b6-528e55321f29 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.387308 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ae926-2a03-45ab-9e05-3c0cdd6911ac admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.395458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.396157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.396503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.396839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.399874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.452424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 725/1453] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:41.452424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.452424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.452424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.478884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:41.480375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.483309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.485225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937834c5-02b0-4333-a31f-0af4e151f265 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.491124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 726/1454] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:41.492279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.499121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 729/1455] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:41.505839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc59fc-8817-4d87-9360-9b63ed1d6934 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.506645 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.506922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.507202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.512477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.513516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.513995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.514435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] PATH_INFO: `/v3/projects/97f7d01b210f48d49576beedf1e6b544/users/68663889ee5f44c088430999ce174fad/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.531901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] MFA Rules not processed for user `94d217e156e944c3ba7dbbab90344e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:41.533149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.533436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f7d01b210f48d49576beedf1e6b544, user_id=68663889ee5f44c088430999ce174fad, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.536648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.608454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 730/1456] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:41.619907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.622231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.628747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 727/1457] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:41 2022] PUT /identity/v3/projects/97f7d01b210f48d49576beedf1e6b544/users/68663889ee5f44c088430999ce174fad/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:41.631256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.800782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf19f-ed00-47e9-be03-89130c3a59f5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.911025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e8ad-086f-40ad-9be1-5708ac2e907e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.935973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.936613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.936949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.937226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.937914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.942818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.948711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.949823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.950172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.951136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.998949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:42.006343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 728/1458] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:42.007312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.056043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eb29d-8c90-49ba-bc5c-a28ab771a27e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.081168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.081843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.082137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.082419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.083087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:42.083432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.104830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.129020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.132007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.167905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 729/1459] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:42.172710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.184132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 731/1460] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:42.186200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.189498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:42.193292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea999f-4685-45d6-8a85-434dba3fbacb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.199208 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.199970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.200492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.200736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.202118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.203948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.221599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 730/1461] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:42.222304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.234786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ee0d-465f-4416-9257-160eb0619cb8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.244462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.245301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.245618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.246002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] PATH_INFO: `/v3/projects/c9329a4a10b647b88259c46e18b8ecf4/users/cfe4a2b5c50d4594a20c923de2274d14/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.269108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9329a4a10b647b88259c46e18b8ecf4, user_id=cfe4a2b5c50d4594a20c923de2274d14, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.277229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.326740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441299e6-a434-4418-a20a-3470c654c6bb service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.327065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:42.331246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.336512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.336512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.336512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.358495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.360102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.391144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 732/1462] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:42.395274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 731/1463] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:42 2022] PUT /identity/v3/projects/c9329a4a10b647b88259c46e18b8ecf4/users/cfe4a2b5c50d4594a20c923de2274d14/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:42.395437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.395516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.425902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd529-14b3-477a-8f85-bc9f622cfa19 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.596316 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0621f8-36c2-4cc7-86b0-edeb062bce67 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.612603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.613336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.613650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.613929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] PATH_INFO: `/v3/projects/97f7d01b210f48d49576beedf1e6b544/users/68663889ee5f44c088430999ce174fad/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.618022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f7d01b210f48d49576beedf1e6b544, user_id=68663889ee5f44c088430999ce174fad, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.624279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.628409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.628965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.629221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.629479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.630221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.632076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.649396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 732/1464] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:42 2022] PUT /identity/v3/projects/97f7d01b210f48d49576beedf1e6b544/users/68663889ee5f44c088430999ce174fad/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:42.650690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.762569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 733/1465] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:42 2022] POST /identity/v3/projects => generated 381 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:42.765281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.831652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4b04-e862-428b-afdf-c5a6320420b8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.975681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e8cc9-dce6-4743-831e-187c9b4c772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.976815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e8cc9-dce6-4743-831e-187c9b4c772b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.977112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e8cc9-dce6-4743-831e-187c9b4c772b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.977377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e8cc9-dce6-4743-831e-187c9b4c772b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.978064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e8cc9-dce6-4743-831e-187c9b4c772b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.981703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e8cc9-dce6-4743-831e-187c9b4c772b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.000867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 733/1466] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:43.002605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.003173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.003473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.007663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a140-b030-41a3-9831-0e0929c4178c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.028354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.029595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.029595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.029816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.039187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:43.049144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] MFA Rules not processed for user `68663889ee5f44c088430999ce174fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:43.072828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:43.310506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 734/1467] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:43.310506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:43.333020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.334563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.334691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7a36-7815-422e-82bc-2fbfe49a3605 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.340830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.341681 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.342467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.342830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.343738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.345882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.386341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 734/1468] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:43.390363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:43.437072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 735/1469] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:43 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:43.437072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:43.441112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:43.498215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d71496-612d-4651-963f-d5b96189a7b8 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.498215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.498215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.498215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.500233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] PATH_INFO: `/v3/projects/c9329a4a10b647b88259c46e18b8ecf4/users/cfe4a2b5c50d4594a20c923de2274d14/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.500233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9329a4a10b647b88259c46e18b8ecf4, user_id=cfe4a2b5c50d4594a20c923de2274d14, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.500233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.501012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10ba22-7a11-4b23-9c54-31b31150d8ed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.532869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec7fa-6203-48fd-bda9-3642a0992904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.537886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec7fa-6203-48fd-bda9-3642a0992904 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.538374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec7fa-6203-48fd-bda9-3642a0992904 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.538814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec7fa-6203-48fd-bda9-3642a0992904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.547120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 735/1470] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:43 2022] PUT /identity/v3/projects/c9329a4a10b647b88259c46e18b8ecf4/users/cfe4a2b5c50d4594a20c923de2274d14/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:43.557104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:43.578984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aec7fa-6203-48fd-bda9-3642a0992904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.582131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aec7fa-6203-48fd-bda9-3642a0992904 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.626197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 736/1471] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:43.628747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe1b5-b7c4-4d29-9429-84e12e564569 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.628747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe1b5-b7c4-4d29-9429-84e12e564569 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.628747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fe1b5-b7c4-4d29-9429-84e12e564569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.712237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6c9f-be4e-4d60-9aa3-bdb28ee1ced9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.713445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-460fe1b5-b7c4-4d29-9429-84e12e564569 None None] MFA Rules not processed for user `cfe4a2b5c50d4594a20c923de2274d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:43.717840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-460fe1b5-b7c4-4d29-9429-84e12e564569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:43.725875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.728887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.728887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.728887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.728887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.733278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.762795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 736/1472] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:43.767413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:43.789008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b99d1-32bf-43e9-8444-824816e6a279 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.804463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.805319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.805758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.806248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.806976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.811205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.831883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 737/1473] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:43.834835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:43.852445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abf66f-62ea-4169-8f5b-27506024e0f7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:43.863235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:43.884455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:43.885094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:43.885380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:43.885683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] PATH_INFO: `/v3/projects/bf5dde73ae784d46b0692970f007a419/users/6be7401f4e5649e4b1d9a2fe16ac412e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:43.925823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5dde73ae784d46b0692970f007a419, user_id=6be7401f4e5649e4b1d9a2fe16ac412e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:43.940948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:43.982667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 737/1474] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:44.209774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 738/1475] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:43 2022] PUT /identity/v3/projects/bf5dde73ae784d46b0692970f007a419/users/6be7401f4e5649e4b1d9a2fe16ac412e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:44.222177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:44.222501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:44.222738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:44.257971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:44.314030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] MFA Rules not processed for user `6be7401f4e5649e4b1d9a2fe16ac412e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:44.318604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:44.403950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676b6b-9e41-4d51-affc-b9058e562693 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:44.408135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:44.413758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:44.413758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:44.413758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:44.487302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 738/1476] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:44.490917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:44.525734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546f727-a7dd-4e10-92ab-0f7c9c562e17 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:44.533697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:44.535065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:44.535828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:44.536315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:44.538668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:44.545444 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:44.547757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:44.586648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 739/1477] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:44.588353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:44.734845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:44.736344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282ac47-5901-4b26-93ba-447b37131916 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:44.769780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 739/1478] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:44.783325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1caeb-5f1a-4265-b06d-c4196a42869f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:44.783325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1caeb-5f1a-4265-b06d-c4196a42869f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:44.783325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1caeb-5f1a-4265-b06d-c4196a42869f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:44.792753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 740/1479] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:43:44 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:44.793703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1caeb-5f1a-4265-b06d-c4196a42869f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:44.840532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681ce5-3e6a-4a82-bfb1-7316f812d500 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:44.846336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc617ad-200a-43bf-89a4-49ed9dbf7bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:44.847634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc617ad-200a-43bf-89a4-49ed9dbf7bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:44.848325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc617ad-200a-43bf-89a4-49ed9dbf7bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:44.848915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc617ad-200a-43bf-89a4-49ed9dbf7bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:44.851605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc617ad-200a-43bf-89a4-49ed9dbf7bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:44.855673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc617ad-200a-43bf-89a4-49ed9dbf7bdc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:45.017376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1caeb-5f1a-4265-b06d-c4196a42869f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:45.038178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:45.038785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:45.039067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:45.039419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] PATH_INFO: `/v3/users/c102ea6ef16440d18191a257c33f12b9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:45.043048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c102ea6ef16440d18191a257c33f12b9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:45.045639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:45.189465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 740/1480] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:44 2022] POST /identity/v3/projects => generated 379 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:45.191344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:45.191779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:45.192315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:45.234305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:45.241007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:45.316830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c102ea6ef16440d18191a257c33f12b9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:45.318745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c102ea6ef16440d18191a257c33f12b9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:45.348625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c102ea6ef16440d18191a257c33f12b9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:45.366724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c102ea6ef16440d18191a257c33f12b9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:45.370932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c102ea6ef16440d18191a257c33f12b9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:45.393903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 741/1481] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:43:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:45.401855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:45.405366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:45.456169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:45.462065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 741/1482] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:44 2022] DELETE /identity/v3/users/c102ea6ef16440d18191a257c33f12b9 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:45.463695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:45.466385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:45.669648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e9a93-b742-4a5d-bb4b-7cd0ad500347 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:45.678967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8879-f6b7-4875-956e-133f337795c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:45.679648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8879-f6b7-4875-956e-133f337795c9 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:45.679952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8879-f6b7-4875-956e-133f337795c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:45.680249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8879-f6b7-4875-956e-133f337795c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:45.683983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e96d-7915-4f24-9fe0-c8aabcf0cc9a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:45.703861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8879-f6b7-4875-956e-133f337795c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:45.708176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8879-f6b7-4875-956e-133f337795c9 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:45.749880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 742/1483] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:45.753955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:45.754238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:45.755914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:45.822423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:45.823669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:45.872833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:45.873532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:45.874976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:45.875251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:45.878441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:45.884049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:46.010227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 742/1484] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:45 2022] POST /identity/v3/users => generated 296 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:46.014966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:46.046359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 743/1485] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:46.051755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ab9d5-0452-43bf-8993-20fd1ed09271 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:46.059985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:46.061595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:46.065892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:46.066611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.070603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.071010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.071728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:46.073512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:46.098576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 743/1486] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:46.105952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:46.138504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac06c-856d-4af0-87bc-f795770c7c4b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:46.152111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb282-e6a5-457d-bf7b-4f4f07b5c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:46.152637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb282-e6a5-457d-bf7b-4f4f07b5c8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.152914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb282-e6a5-457d-bf7b-4f4f07b5c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.153237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb282-e6a5-457d-bf7b-4f4f07b5c8e8 admin admin] PATH_INFO: `/v3/projects/d3c63f720e56477ea296c31ce5cce19a/users/4101d2f303f24b1baaea54f7bdd330ec/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.199575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbb282-e6a5-457d-bf7b-4f4f07b5c8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c63f720e56477ea296c31ce5cce19a, user_id=4101d2f303f24b1baaea54f7bdd330ec, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:46.202306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbb282-e6a5-457d-bf7b-4f4f07b5c8e8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:46.217382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b542f-cfd7-4bb0-97f3-fe60a225deb8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:46.237424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:46.238232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.238568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.238844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.258400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:46.264826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:46.273899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 744/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:46.292752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 744/1488] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:46 2022] PUT /identity/v3/projects/d3c63f720e56477ea296c31ce5cce19a/users/4101d2f303f24b1baaea54f7bdd330ec/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:46.293691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:46.341043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcebb9-8a49-465a-8113-d2107dfc7445 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:46.355516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafbf91-f86a-4c10-8cbb-49ef446a7427 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.355804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafbf91-f86a-4c10-8cbb-49ef446a7427 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.356175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafbf91-f86a-4c10-8cbb-49ef446a7427 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.357692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 745/1489] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:43:46.514833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.515377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.515804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.555340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:46.559053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.559053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.560221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.560483 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:46.561744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:46.562149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:46.565036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:46.605207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 745/1490] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:46.612248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:46.638211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4e39b-b0ef-414f-bfc2-5795afabed38 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:46.653369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d78ae-9e6b-49ef-a688-0fa1dba0adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:46.654598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d78ae-9e6b-49ef-a688-0fa1dba0adeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.654939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d78ae-9e6b-49ef-a688-0fa1dba0adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.655476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d78ae-9e6b-49ef-a688-0fa1dba0adeb admin admin] PATH_INFO: `/v3/projects/d3c63f720e56477ea296c31ce5cce19a/users/4101d2f303f24b1baaea54f7bdd330ec/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.660133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d78ae-9e6b-49ef-a688-0fa1dba0adeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c63f720e56477ea296c31ce5cce19a, user_id=4101d2f303f24b1baaea54f7bdd330ec, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:46.666937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d78ae-9e6b-49ef-a688-0fa1dba0adeb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:46.711347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 746/1491] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:46 2022] PUT /identity/v3/projects/d3c63f720e56477ea296c31ce5cce19a/users/4101d2f303f24b1baaea54f7bdd330ec/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:46.714753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.719772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.719772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:46.744822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 746/1492] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:46.780920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:46.782385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] MFA Rules not processed for user `4101d2f303f24b1baaea54f7bdd330ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:46.784726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:46.784849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:46.850954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735ed4a-351b-4350-85df-372b30b6dad7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:46.976464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:46.980997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:46.981293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:46.981623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:47.012552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:47.014360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:47.042100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 747/1493] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:47.046313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 747/1494] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:47.303379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:47.312743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:47.345183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.475384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14271b-31fc-48b6-97ed-0b72b488a586 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:47.484932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:47.487377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:47.487963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:47.490684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:47.518796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:47.522512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:47.582460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 748/1495] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:47.790041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:47.792532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:47.912869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68ff0-d7de-44d5-94ff-38448eda2a6b service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:47.914833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:47.916007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:47.916283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:47.916610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] PATH_INFO: `/v3/projects/6db7bddfb3ab49669fd2a71a9c46821a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:47.917996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db7bddfb3ab49669fd2a71a9c46821a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:47.922339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:48.148504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db7bddfb3ab49669fd2a71a9c46821a', 'request_id': 'req-39f963bb-5ab7-4713-9517-4dba7f74b4e4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.158999 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db7bddfb3ab49669fd2a71a9c46821a', 'request_id': 'req-39f963bb-5ab7-4713-9517-4dba7f74b4e4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.241966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db7bddfb3ab49669fd2a71a9c46821a', 'request_id': 'req-39f963bb-5ab7-4713-9517-4dba7f74b4e4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.255761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] The token cache is being invalidate because project 6db7bddfb3ab49669fd2a71a9c46821a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:48.256054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.261607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.263997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 748/1496] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:47 2022] DELETE /identity/v3/projects/6db7bddfb3ab49669fd2a71a9c46821a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:48.268105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:48.280700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348411b-8c16-48d0-ab91-12102584cbfd service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:48.397695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:48.397695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:48.397695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:48.397695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] PATH_INFO: `/v3/users/cfe4a2b5c50d4594a20c923de2274d14` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:48.398197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe4a2b5c50d4594a20c923de2274d14)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:48.398197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:48.739692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.768576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe4a2b5c50d4594a20c923de2274d14'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.769463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe4a2b5c50d4594a20c923de2274d14'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.785471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe4a2b5c50d4594a20c923de2274d14'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.795502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe4a2b5c50d4594a20c923de2274d14'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.796786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe4a2b5c50d4594a20c923de2274d14'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:48.904549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 749/1497] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:48 2022] DELETE /identity/v3/users/cfe4a2b5c50d4594a20c923de2274d14 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:49.152408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.182793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.184854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:49.304673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f963bb-5ab7-4713-9517-4dba7f74b4e4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.482317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4101d2f303f24b1baaea54f7bdd330ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3c63f720e56477ea296c31ce5cce19a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.482986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.483275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.483562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.484318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:49.484562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.486300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:49.505783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.507578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:49.511186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 749/1498] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:49.538757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210afd-ba8b-484b-94b4-cd2efd7d0947 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.544816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4101d2f303f24b1baaea54f7bdd330ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3c63f720e56477ea296c31ce5cce19a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.545769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.546280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.546773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.547576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.550293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:49.593362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.595362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:49.662282 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 750/1499] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:49 2022] POST /identity/v3/projects => generated 355 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:49.665028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.724518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876b16e-b4c1-4b55-8d80-c2eb3e30a770 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.777781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b19318-3d06-4e33-901f-2f60cab07c6c tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.792286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4101d2f303f24b1baaea54f7bdd330ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3c63f720e56477ea296c31ce5cce19a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.793054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.793383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.793688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.794544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:49.794778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.797481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:49.816065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 751/1500] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:49.836498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.838633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.838931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.840065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] PATH_INFO: `/v3/projects/c9329a4a10b647b88259c46e18b8ecf4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.842934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9329a4a10b647b88259c46e18b8ecf4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.847038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:49.907228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:49.919868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28776c1-d68c-40f3-b3a3-45978ec30b76 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:49.926357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4101d2f303f24b1baaea54f7bdd330ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3c63f720e56477ea296c31ce5cce19a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:49.927058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:49.927349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:49.927659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] PATH_INFO: `/v3/projects/10e8990c56a2420e88714fa23202f28b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:49.929132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10e8990c56a2420e88714fa23202f28b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:49.932063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:50.329057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9329a4a10b647b88259c46e18b8ecf4', 'request_id': 'req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.331182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e8990c56a2420e88714fa23202f28b', 'request_id': 'req-99dc2f9b-dff5-4fc2-9427-c536870df8f7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.340248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e8990c56a2420e88714fa23202f28b', 'request_id': 'req-99dc2f9b-dff5-4fc2-9427-c536870df8f7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.347396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9329a4a10b647b88259c46e18b8ecf4', 'request_id': 'req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.424652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e8990c56a2420e88714fa23202f28b', 'request_id': 'req-99dc2f9b-dff5-4fc2-9427-c536870df8f7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.435654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] The token cache is being invalidate because project 10e8990c56a2420e88714fa23202f28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:50.436383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.436605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-99dc2f9b-dff5-4fc2-9427-c536870df8f7 tempest-VolumeQuotaClassesTest-933621090 tempest-VolumeQuotaClassesTest-933621090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.438133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 752/1501] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:49 2022] DELETE /identity/v3/projects/10e8990c56a2420e88714fa23202f28b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:50.499374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9329a4a10b647b88259c46e18b8ecf4', 'request_id': 'req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.523088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] The token cache is being invalidate because project c9329a4a10b647b88259c46e18b8ecf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:50.523685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.525573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-32eb32ae-7ea1-4f04-8c02-9f12241b7ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:50.527559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 750/1502] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:49 2022] DELETE /identity/v3/projects/c9329a4a10b647b88259c46e18b8ecf4 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:50.532471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:50.537674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:50.537674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:50.568029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:50.583758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:50.662634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 753/1503] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:50.670521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:50.670812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:50.671088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:50.692217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:50.693671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:50.705947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 751/1504] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:50.715046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:50.728186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27bfc2-f77a-4c06-a919-a6b6741f1d0d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:50.733657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:50.734293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:50.734581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:50.734842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:50.735485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:50.735796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:50.737617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:50.749745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 754/1505] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:50.754259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:50.764096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9efdc7-e726-4ed9-af7e-e50ed17748b1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:50.779178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:50.779178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:50.779634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:50.779861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:50.780516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:50.782944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:50.869424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.891987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 752/1506] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:50 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:50.892776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:50.905409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbc712-6d98-4990-b77b-af73f8b310ca admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:50.981751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:50.982530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:50.982907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:50.983250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:50.983953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:50.993259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:51.108214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 755/1507] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:50 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:51.111371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:51.122862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54f37-2251-4d00-91ba-93a847a69b6e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:51.134941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:51.135877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:51.136239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:51.136585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:51.137408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:51.140972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:51.178226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 753/1508] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:51.186262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:51.200549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede2eba-cbc9-4d1e-9c53-53e63a518320 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:51.214166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e61b-4744-4acc-aa02-c502ae4d32e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:51.214940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e61b-4744-4acc-aa02-c502ae4d32e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:51.215315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e61b-4744-4acc-aa02-c502ae4d32e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:51.215629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e61b-4744-4acc-aa02-c502ae4d32e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:51.216352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e61b-4744-4acc-aa02-c502ae4d32e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:51.218084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e61b-4744-4acc-aa02-c502ae4d32e5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:51.238779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 756/1509] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:51.242717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:51.253808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493bc3-0a41-4f01-ab13-08ad8c488368 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:51.259882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:51.260743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:51.261170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:51.261673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] PATH_INFO: `/v3/projects/8423e1e05859407b810db286c6460d48/users/00d4be06b08a43b0919d2a7a6c66979f/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:51.322455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8423e1e05859407b810db286c6460d48, user_id=00d4be06b08a43b0919d2a7a6c66979f, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:51.339056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:51.579622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:51.632249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 754/1510] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:51 2022] PUT /identity/v3/projects/8423e1e05859407b810db286c6460d48/users/00d4be06b08a43b0919d2a7a6c66979f/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:51.641186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:51.641501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:51.641917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:51.700064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] MFA Rules not processed for user `00d4be06b08a43b0919d2a7a6c66979f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:51.700064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:51.702568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:51.704907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:51.823662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ee86f-456e-48e5-a731-9f96fcb73423 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:51.826315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 757/1511] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:51.829281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:51.830098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:51.830442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:51.830889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] PATH_INFO: `/v3/users/6be7401f4e5649e4b1d9a2fe16ac412e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:51.832535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be7401f4e5649e4b1d9a2fe16ac412e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:51.835329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:51.964013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:51.966663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.036080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852963-67d6-4230-95c9-c8fc9f946ef8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:52.040635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:52.041350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.041785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.042166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.054587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:52.056600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:52.069012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 758/1512] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:52.089420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:52.102370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be7401f4e5649e4b1d9a2fe16ac412e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.102600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28821d-7ab9-4c76-8467-9248b152ae88 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:52.105799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be7401f4e5649e4b1d9a2fe16ac412e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.107762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:52.108352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.108629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.108900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] PATH_INFO: `/v3/users/00d4be06b08a43b0919d2a7a6c66979f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.110090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d4be06b08a43b0919d2a7a6c66979f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:52.112480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:52.121331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be7401f4e5649e4b1d9a2fe16ac412e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.216832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be7401f4e5649e4b1d9a2fe16ac412e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.238615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be7401f4e5649e4b1d9a2fe16ac412e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.260262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 755/1513] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:51 2022] DELETE /identity/v3/users/6be7401f4e5649e4b1d9a2fe16ac412e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:52.261118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:52.267132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.320399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d4be06b08a43b0919d2a7a6c66979f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.320399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d4be06b08a43b0919d2a7a6c66979f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.333874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d4be06b08a43b0919d2a7a6c66979f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.342828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d4be06b08a43b0919d2a7a6c66979f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.347881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b87e585e-87bd-4638-8701-3ae17e938566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d4be06b08a43b0919d2a7a6c66979f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.360292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d747f-8577-4e5a-afab-5f0ec0d1145f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:52.365128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:52.365799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.366139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.366429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] PATH_INFO: `/v3/users/7b72ce7db89641b2a0cc705162e01ab2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.367590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b72ce7db89641b2a0cc705162e01ab2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:52.370408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:52.453504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 759/1514] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:52 2022] DELETE /identity/v3/users/00d4be06b08a43b0919d2a7a6c66979f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:52.454828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192737-50ae-4f10-b812-104b4cea0530 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.455117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192737-50ae-4f10-b812-104b4cea0530 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.455393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192737-50ae-4f10-b812-104b4cea0530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.475085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-67192737-50ae-4f10-b812-104b4cea0530 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:52.480954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-67192737-50ae-4f10-b812-104b4cea0530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.543984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 760/1515] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:52.545239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.545530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.545834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.566434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:52.567654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.575421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 761/1516] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:52.576182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:52.577375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.594291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b72ce7db89641b2a0cc705162e01ab2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.595100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b72ce7db89641b2a0cc705162e01ab2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.608145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b72ce7db89641b2a0cc705162e01ab2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.639459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09e44c-54d3-48e7-8d24-4cf8e5255b34 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:52.643105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:52.643825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.643999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.644275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.646043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.658461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:52.659877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:52.669924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 762/1517] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:52.670706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:52.672001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.682612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d37c03-7e00-4e0f-80ad-40f9855fef6b service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:52.688468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:52.689096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.689370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.689679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.691613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.704445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:52.706011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dca36a-038c-4565-92f5-9092c75955d2 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:52.717528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 763/1518] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:52.731327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b72ce7db89641b2a0cc705162e01ab2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.741287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b72ce7db89641b2a0cc705162e01ab2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:52.749020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 756/1519] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:52 2022] DELETE /identity/v3/users/7b72ce7db89641b2a0cc705162e01ab2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:52.753534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.753844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.754118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.776076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:52.777266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.846725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 764/1520] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:52.857365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:52.858914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:52.930927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e210-9458-4096-b39a-14b31dd340c8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:52.935720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:52.935720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:52.936536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:52.936536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:52.946592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:52.948020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:52.970208 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 757/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:53.123030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:53.248180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.250131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.263730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3d86e-0362-452b-8bcf-7d0c143444dd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:53.275248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:53.275248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.275248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.275248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] PATH_INFO: `/v3/projects/8423e1e05859407b810db286c6460d48` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.275522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8423e1e05859407b810db286c6460d48)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:53.276733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:53.277927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.279661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.297757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f19aa-26c4-41ad-a174-2b5c15306efb service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:53.303589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:53.304356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.304706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.305069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] PATH_INFO: `/v3/projects/bf5dde73ae784d46b0692970f007a419` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.306481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5dde73ae784d46b0692970f007a419)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:53.308556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:53.400984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8423e1e05859407b810db286c6460d48', 'request_id': 'req-b5c6690b-dbca-45d4-a444-c592aecb21d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.411176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8423e1e05859407b810db286c6460d48', 'request_id': 'req-b5c6690b-dbca-45d4-a444-c592aecb21d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.482007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8423e1e05859407b810db286c6460d48', 'request_id': 'req-b5c6690b-dbca-45d4-a444-c592aecb21d1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.493085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5dde73ae784d46b0692970f007a419', 'request_id': 'req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.506818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] The token cache is being invalidate because project 8423e1e05859407b810db286c6460d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:53.507117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.508139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b5c6690b-dbca-45d4-a444-c592aecb21d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.512038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5dde73ae784d46b0692970f007a419', 'request_id': 'req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.515052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 765/1522] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:53 2022] DELETE /identity/v3/projects/8423e1e05859407b810db286c6460d48 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:53.522523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71520d-310b-4998-a660-15392f319af1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.523209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71520d-310b-4998-a660-15392f319af1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.523636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71520d-310b-4998-a660-15392f319af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.549419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6f71520d-310b-4998-a660-15392f319af1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:53.552602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6f71520d-310b-4998-a660-15392f319af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.641631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 766/1523] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:53.641631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71520d-310b-4998-a660-15392f319af1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.646942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6f71520d-310b-4998-a660-15392f319af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.664238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71520d-310b-4998-a660-15392f319af1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:53.671393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:53.672067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.672349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.672622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] PATH_INFO: `/v3/projects/f9fd508a020146ea80760c839db11d08` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.673800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9fd508a020146ea80760c839db11d08)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:53.675707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:53.698751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5dde73ae784d46b0692970f007a419', 'request_id': 'req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.709608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] The token cache is being invalidate because project bf5dde73ae784d46b0692970f007a419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:53.709897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.710531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0fdeae71-1c36-4a6e-b53e-bf881bed99fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.712782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 758/1524] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:53 2022] DELETE /identity/v3/projects/bf5dde73ae784d46b0692970f007a419 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:53.718946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:53.719078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.719078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.719078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.737132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:53.738365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.746251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 759/1525] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:53.747013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.750701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.759912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a004c7-0b89-439f-ad0f-cd55c23cb37c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:53.764391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:53.764978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.765266 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.765565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] PATH_INFO: `/v3/users/4101d2f303f24b1baaea54f7bdd330ec` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.766701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4101d2f303f24b1baaea54f7bdd330ec)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:53.768601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:53.804461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9fd508a020146ea80760c839db11d08', 'request_id': 'req-870f9d46-d573-4ab1-bf7f-482b80e84f03'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.811440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9fd508a020146ea80760c839db11d08', 'request_id': 'req-870f9d46-d573-4ab1-bf7f-482b80e84f03'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.898383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9fd508a020146ea80760c839db11d08', 'request_id': 'req-870f9d46-d573-4ab1-bf7f-482b80e84f03'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.909366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] The token cache is being invalidate because project f9fd508a020146ea80760c839db11d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:53.909686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.910320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:53.911815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 767/1526] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:53 2022] DELETE /identity/v3/projects/f9fd508a020146ea80760c839db11d08 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:53.912658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.913955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.976735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9d46-d573-4ab1-bf7f-482b80e84f03 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:53.981231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:53.981862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.982139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.982410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.983039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:53.983340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:53.984917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:53.996562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 768/1527] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:53.997244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.998870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:54.004711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4101d2f303f24b1baaea54f7bdd330ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.005455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4101d2f303f24b1baaea54f7bdd330ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.012004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f454a-2eb8-408e-a581-3119d0fdfbcd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.016513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.017113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.017381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.017676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] PATH_INFO: `/v3/users/9e05af1281e04151ae8e13245c5abe44` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.018393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4101d2f303f24b1baaea54f7bdd330ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.018766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e05af1281e04151ae8e13245c5abe44)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.020650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.110186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4101d2f303f24b1baaea54f7bdd330ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.117618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4101d2f303f24b1baaea54f7bdd330ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.123496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 760/1528] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:53 2022] DELETE /identity/v3/users/4101d2f303f24b1baaea54f7bdd330ec => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:54.124241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:54.125519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:54.194170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672d24-d3ae-4bab-888b-32fc6b116bc9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.199952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.200651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.201028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.201348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.202098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.204315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.204937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e05af1281e04151ae8e13245c5abe44'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.205760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e05af1281e04151ae8e13245c5abe44'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.218746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e05af1281e04151ae8e13245c5abe44'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.227146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e05af1281e04151ae8e13245c5abe44'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.228002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e05af1281e04151ae8e13245c5abe44'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.303948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 761/1529] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:54 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:54.308342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:54.310049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:54.325893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 769/1530] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:53 2022] DELETE /identity/v3/users/9e05af1281e04151ae8e13245c5abe44 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:54.399029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491482ae-5e7b-475b-a9d4-3f5d3f564b64 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.478139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.478846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.479382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.479594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.480318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.482431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.578626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:54.580016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:54.585484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 762/1531] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:54 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:54.587953 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:54.593914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dde02-e66d-4f1e-8fec-614bc641687d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.609920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.611175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.611460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.611964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] PATH_INFO: `/v3/projects/d3c63f720e56477ea296c31ce5cce19a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.613170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c63f720e56477ea296c31ce5cce19a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.626064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.626163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b82b3-0f70-4bff-8257-b01ed3ce8c8e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.633171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.633934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.634284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.634616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.635972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.637885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.662337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 763/1532] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:54.669789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:54.704906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb8140-00e7-461b-9292-c467ae3010ad admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.718702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.723954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.724305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.724588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.725874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.731457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.752729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 764/1533] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:54.753688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:54.791317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c63f720e56477ea296c31ce5cce19a', 'request_id': 'req-59207b41-f07c-436e-b9be-b9dad109d0e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.792983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db55d-7652-4a40-92aa-7e578fb5191a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:54.801525 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c63f720e56477ea296c31ce5cce19a', 'request_id': 'req-59207b41-f07c-436e-b9be-b9dad109d0e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.874153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46a8da-1f6d-46df-a6bb-6433b4debc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:54.874829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a8da-1f6d-46df-a6bb-6433b4debc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.875113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a8da-1f6d-46df-a6bb-6433b4debc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.875386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a8da-1f6d-46df-a6bb-6433b4debc96 admin admin] PATH_INFO: `/v3/projects/63322d8eb59d440c9c0b306d79680b58/users/3c1f07982ee34c77bd2b2e848bbf0600/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.893941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c63f720e56477ea296c31ce5cce19a', 'request_id': 'req-59207b41-f07c-436e-b9be-b9dad109d0e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.909231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] The token cache is being invalidate because project d3c63f720e56477ea296c31ce5cce19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:54.909720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.911435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-59207b41-f07c-436e-b9be-b9dad109d0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:54.911631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46a8da-1f6d-46df-a6bb-6433b4debc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63322d8eb59d440c9c0b306d79680b58, user_id=3c1f07982ee34c77bd2b2e848bbf0600, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:54.915967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46a8da-1f6d-46df-a6bb-6433b4debc96 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:54.916406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 770/1534] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:54 2022] DELETE /identity/v3/projects/d3c63f720e56477ea296c31ce5cce19a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:54.923632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abd106-bf88-496d-b32d-b70b0bdceb6b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.924116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abd106-bf88-496d-b32d-b70b0bdceb6b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.924444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abd106-bf88-496d-b32d-b70b0bdceb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.953695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-96abd106-bf88-496d-b32d-b70b0bdceb6b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:54.955382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-96abd106-bf88-496d-b32d-b70b0bdceb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:54.965195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 771/1535] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:54.974237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:54.974739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:54.975661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:54.999200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 765/1536] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:54 2022] PUT /identity/v3/projects/63322d8eb59d440c9c0b306d79680b58/users/3c1f07982ee34c77bd2b2e848bbf0600/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:55.011713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.011713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.011713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.031969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:55.035414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.104400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] MFA Rules not processed for user `3c1f07982ee34c77bd2b2e848bbf0600`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:55.105678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.126570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 772/1537] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:55.130422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.156803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d8a1a-82a1-447e-b0cc-42693d4a882c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:55.170302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:55.171415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.171790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.172161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.173105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:55.173655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:55.182427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:55.237899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 773/1538] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:43:55.237899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.247271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 766/1539] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:55.259536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.261247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.267837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12654bb-410b-41a7-bebe-7237a245efe3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:55.272961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:55.273603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.273882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.274823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.275472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:55.277406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:55.322794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff85896-066b-4c9f-9101-58f774afa050 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:55.326414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:55.327056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.327324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.327595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.335784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:55.337886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:55.346414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 767/1540] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:55.364563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.366034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.388565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73a71c-51d4-48b9-8805-e05a533ae5ab service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:55.393690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:55.394414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.394763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.395129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] PATH_INFO: `/v3/projects/4726cd4e1d3343a29f7d34cdadb843c5` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.396440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4726cd4e1d3343a29f7d34cdadb843c5)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:55.398359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:55.402867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 774/1541] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:55 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:55.403731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.408458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.470458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713e79e-e1c9-41a9-bad8-38b4136e3e32 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:55.475952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:55.476579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.476890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.477189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] PATH_INFO: `/v3/users/3c1f07982ee34c77bd2b2e848bbf0600` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.478358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1f07982ee34c77bd2b2e848bbf0600)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:55.480314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:55.528262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4726cd4e1d3343a29f7d34cdadb843c5', 'request_id': 'req-f74d8dad-5fe3-42f0-927e-b8924c2d7608'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.535149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4726cd4e1d3343a29f7d34cdadb843c5', 'request_id': 'req-f74d8dad-5fe3-42f0-927e-b8924c2d7608'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.619148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4726cd4e1d3343a29f7d34cdadb843c5', 'request_id': 'req-f74d8dad-5fe3-42f0-927e-b8924c2d7608'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.638309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] The token cache is being invalidate because project 4726cd4e1d3343a29f7d34cdadb843c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:55.638604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.639277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.644492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 768/1542] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:55 2022] DELETE /identity/v3/projects/4726cd4e1d3343a29f7d34cdadb843c5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:55.644492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.644492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.731810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8dad-5fe3-42f0-927e-b8924c2d7608 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:55.736968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:55.737650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.738209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.738209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.738993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:55.741007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:55.751410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1f07982ee34c77bd2b2e848bbf0600'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.759659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1f07982ee34c77bd2b2e848bbf0600'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.765057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1f07982ee34c77bd2b2e848bbf0600'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.771861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1f07982ee34c77bd2b2e848bbf0600'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.772574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a599eb10-a47d-4209-8dde-2eb359c10bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1f07982ee34c77bd2b2e848bbf0600'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:55.970146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 775/1543] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:55 2022] DELETE /identity/v3/users/3c1f07982ee34c77bd2b2e848bbf0600 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:55.970679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 769/1544] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:55 2022] POST /identity/v3/users => generated 289 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:55.970775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a881b-4e46-465c-a7ac-a768ed4d668d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:55.970775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a881b-4e46-465c-a7ac-a768ed4d668d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:55.970775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a881b-4e46-465c-a7ac-a768ed4d668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:55.971002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:55.971002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:55.996676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f4a9-6a9d-49c2-93c1-6fd3e3764790 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.023310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f05a881b-4e46-465c-a7ac-a768ed4d668d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:56.024753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f05a881b-4e46-465c-a7ac-a768ed4d668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.113661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2717-9e67-4794-9dca-b36468e1676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.123505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2717-9e67-4794-9dca-b36468e1676b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.126509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2717-9e67-4794-9dca-b36468e1676b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.126803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2717-9e67-4794-9dca-b36468e1676b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.127521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2717-9e67-4794-9dca-b36468e1676b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.129178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2717-9e67-4794-9dca-b36468e1676b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.157519 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 776/1545] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:56.163534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 770/1546] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:56.163915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.163915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.163915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.170553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.170845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.171131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.201637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:56.203457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.207714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:56.209053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.215350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 771/1547] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:56.216320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.217888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 777/1548] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:56.225042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.226941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b165a5-577b-4d98-b20d-3c68383b193a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.232534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.233199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.233479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.233805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.234451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.236134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.237924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26d0e5-d74b-4bc1-b5cf-3a358dc16c08 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.242557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.243795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.244162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.244489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.245191 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:56.245578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.247217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.247685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 772/1549] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:56.248458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.250898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.262440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 778/1550] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:43:56.262440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.271910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56154e7-aebd-486d-ad37-ad7d17b5fc9b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.276990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867a70e-19dc-46fb-88fc-3b1215532633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.277666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a70e-19dc-46fb-88fc-3b1215532633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.277949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a70e-19dc-46fb-88fc-3b1215532633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.278226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867a70e-19dc-46fb-88fc-3b1215532633 admin admin] PATH_INFO: `/v3/projects/a73f7632e1df43f18afb4cf3e15af047/users/0c6bc17d0585441690232c627d52ccbd/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.294947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867a70e-19dc-46fb-88fc-3b1215532633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73f7632e1df43f18afb4cf3e15af047, user_id=0c6bc17d0585441690232c627d52ccbd, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.297643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867a70e-19dc-46fb-88fc-3b1215532633 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.312381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47c701-484b-4c67-b3bc-7d971015fa25 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.316066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.316662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.316934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.317200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.325952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.327350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.336488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 773/1551] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:56.337299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.345743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:56.348184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f965-2e19-4dad-97cc-d47ad8c00d04 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.354070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.354788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.355088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.355361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.355978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.357892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.385731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 779/1552] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:56 2022] PUT /identity/v3/projects/a73f7632e1df43f18afb4cf3e15af047/users/0c6bc17d0585441690232c627d52ccbd/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:56.394460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.395219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.395679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.429032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] MFA Rules not processed for user `0c6bc17d0585441690232c627d52ccbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:56.431267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.438479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 774/1553] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:56.442637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.505963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 780/1554] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:56.507270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935e14-2be6-4cf5-a562-d473613fdbaf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.510437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.512081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.512682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.512963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.513235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.514229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.516610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.571549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705005f-94be-4d7d-834b-d4b19c61e96f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.576430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.578490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.578490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.578490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.578490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.580171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.602279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:56.612316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 775/1555] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:56.615140 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.627430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ad194-059e-4160-99c1-28495f066582 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.633109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.633757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.634038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.634311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.634958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.636757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.647700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 776/1556] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:56.652144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.661847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64c80-1e8e-4e2a-9acf-7a4e573bcf37 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.667623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.668218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.668498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.668774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.669405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.671123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.684005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 781/1557] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:56.684222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 777/1558] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:56.687380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.687515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.699275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef68e32-07e7-47e2-8d9e-f736429ca06b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.756256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696250fb-ee6c-4b3e-a8d3-de7009d7d144 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.759114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.759774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.760043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.760319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] PATH_INFO: `/v3/projects/d0eeb4f38f1f47afac6c81445d0430f1/users/5246d08cd1164beeba91f1840cc2d4c9/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.761475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c89a-60cb-4549-9bfd-f17ef12d048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.762087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c89a-60cb-4549-9bfd-f17ef12d048d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.762371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c89a-60cb-4549-9bfd-f17ef12d048d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.762643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c89a-60cb-4549-9bfd-f17ef12d048d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.763274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c89a-60cb-4549-9bfd-f17ef12d048d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.765167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c89a-60cb-4549-9bfd-f17ef12d048d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.775403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0eeb4f38f1f47afac6c81445d0430f1, user_id=5246d08cd1164beeba91f1840cc2d4c9, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.778126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.857295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 778/1559] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:56 2022] PUT /identity/v3/projects/d0eeb4f38f1f47afac6c81445d0430f1/users/5246d08cd1164beeba91f1840cc2d4c9/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:56.857295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.857295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.858051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 782/1560] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:56.860182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.860506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.860847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.897051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] MFA Rules not processed for user `5246d08cd1164beeba91f1840cc2d4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:56.898399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.946994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd9f1e-bf0c-4ac1-99e8-8412f77db617 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.952238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.952880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.953168 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.953434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] PATH_INFO: `/v3/projects/63322d8eb59d440c9c0b306d79680b58` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.954604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63322d8eb59d440c9c0b306d79680b58)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.956508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:56.975680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 783/1561] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:56.975680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.987099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0046da-d238-4237-b48e-51486dfe119a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.001564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.001564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.001564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.001564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.001944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.001944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.005444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 784/1562] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:57.006330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.016025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c7d2-93a8-4e2f-8c14-dc28b3590630 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.020583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.021717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.021717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.021717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.022352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.024836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.057041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63322d8eb59d440c9c0b306d79680b58', 'request_id': 'req-3f40aa22-2201-4f40-b52b-5a9502c94372'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.063832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63322d8eb59d440c9c0b306d79680b58', 'request_id': 'req-3f40aa22-2201-4f40-b52b-5a9502c94372'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.130657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 785/1563] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:57.130657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.148509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63322d8eb59d440c9c0b306d79680b58', 'request_id': 'req-3f40aa22-2201-4f40-b52b-5a9502c94372'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.161174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] The token cache is being invalidate because project 63322d8eb59d440c9c0b306d79680b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:57.161467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.162145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.163721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 779/1564] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:56 2022] DELETE /identity/v3/projects/63322d8eb59d440c9c0b306d79680b58 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:57.164609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.166003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:57.197504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd18b-dc85-4fb6-9fb0-d81f7e56925c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.202499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e304e78-f722-4164-a7e8-31c6fb9201a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.203108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e304e78-f722-4164-a7e8-31c6fb9201a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.203386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e304e78-f722-4164-a7e8-31c6fb9201a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.203660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e304e78-f722-4164-a7e8-31c6fb9201a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.204298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e304e78-f722-4164-a7e8-31c6fb9201a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.205950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e304e78-f722-4164-a7e8-31c6fb9201a4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.229783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 786/1565] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:57.230065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.230363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.231585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.252963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:57.254847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:57.260433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40aa22-2201-4f40-b52b-5a9502c94372 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.263949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 787/1566] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:57.264892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.266278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:57.274316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48fddf-db08-4df6-8a96-331ff1bf3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.275069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fddf-db08-4df6-8a96-331ff1bf3499 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.275412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fddf-db08-4df6-8a96-331ff1bf3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.275752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fddf-db08-4df6-8a96-331ff1bf3499 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.276460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48fddf-db08-4df6-8a96-331ff1bf3499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.278514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48fddf-db08-4df6-8a96-331ff1bf3499 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.279040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af7e-aa3d-4cf7-8543-6686417db976 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.284136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.285703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.289592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.289592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] PATH_INFO: `/v3/projects/d55a0fbb3181494c888819349e809ca6/users/ca26a652f5014de09fd00941c5566192/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.302068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55a0fbb3181494c888819349e809ca6, user_id=ca26a652f5014de09fd00941c5566192, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.304732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.413364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 780/1567] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:57.414858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.415964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.415964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.435370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:57.436562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:57.444632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 781/1568] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:57.445423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.448856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 788/1569] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:57 2022] PUT /identity/v3/projects/d55a0fbb3181494c888819349e809ca6/users/ca26a652f5014de09fd00941c5566192/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:57.456780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1befd5c-0d61-4669-a6de-08a1bd4b81b3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.458237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.531637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77be5c-8944-4b8f-8081-8e3429847b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.532248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77be5c-8944-4b8f-8081-8e3429847b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.532528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77be5c-8944-4b8f-8081-8e3429847b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.532799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77be5c-8944-4b8f-8081-8e3429847b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.533465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77be5c-8944-4b8f-8081-8e3429847b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.534021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6db2-bcfc-48b2-9714-5e26f00a6114 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.535200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77be5c-8944-4b8f-8081-8e3429847b69 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.538905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.540018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.540298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.540566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.541232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:57.541529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.543302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.547365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 782/1570] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:57.548717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.549119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.549484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.559366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 789/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:57.560706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.576935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328b36-913e-45ed-a539-e4995d07d0f0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.578130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.578822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.579477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.579477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] PATH_INFO: `/v3/projects/60673667597f44d8b2643800ee13931d/users/807c6358457d4c5aa711abc1120953ca/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.582428 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] MFA Rules not processed for user `ca26a652f5014de09fd00941c5566192`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:57.583675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:57.595190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=60673667597f44d8b2643800ee13931d, user_id=807c6358457d4c5aa711abc1120953ca, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.597965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.646934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 783/1572] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:57.647828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.657817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a94d-f124-4afe-8e62-ae9b473f77a2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.662288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.667467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.667467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.667467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.667467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.667467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.696442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 790/1573] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:57 2022] PUT /identity/v3/projects/60673667597f44d8b2643800ee13931d/users/807c6358457d4c5aa711abc1120953ca/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:57.696442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.754108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875340f1-4d00-44d5-82b3-1688723e2fce admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.758769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.759277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.759673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.759849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.760471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.762369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.809027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 784/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:57.812499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.875609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e04432-87cc-4e0d-b302-cfd4d7cea57e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.888247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.888247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.888247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.888247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.888629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 791/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:57.888715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.888802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.888882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.897250 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 785/1576] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:57.898044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.909177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea36f0c-8d62-4979-ab9b-6360afbbdf34 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.953695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ab90-30af-4d8b-935a-442a09eb92d1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.958405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.959011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.959293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.959568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.960201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.962701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.989010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.989861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.990149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.990421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.991498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.993746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.095257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 792/1577] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:58.098051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.101174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 786/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:57 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:58.101174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.118972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83958b-9d71-4203-a3ea-373ef115e307 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.120453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034bb9-098c-4523-b0a0-b28e35ae6a5b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.130292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.132886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.132886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.132886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.132886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.134676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.139186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.139879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.140193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.140478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] PATH_INFO: `/v3/projects/60673667597f44d8b2643800ee13931d/users/807c6358457d4c5aa711abc1120953ca/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.143441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60673667597f44d8b2643800ee13931d, user_id=807c6358457d4c5aa711abc1120953ca, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.148301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.163082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 787/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:58.163937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 793/1580] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:58 2022] PUT /identity/v3/projects/60673667597f44d8b2643800ee13931d/users/807c6358457d4c5aa711abc1120953ca/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:58.167533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.168756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.188398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0869b-5b9c-4101-84ab-d6f87bfe90a4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.299735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a3d5-231f-4ebf-83eb-f1bd2ca7b4c5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.305296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e3168-740f-44b9-b10b-2f05ef45fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.306255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e3168-740f-44b9-b10b-2f05ef45fdab admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.306854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e3168-740f-44b9-b10b-2f05ef45fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.307304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e3168-740f-44b9-b10b-2f05ef45fdab admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.308132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e3168-740f-44b9-b10b-2f05ef45fdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.310199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e3168-740f-44b9-b10b-2f05ef45fdab admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.322827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.323494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.323782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.324056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.324250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 794/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:58.324837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.326362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.326826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.328578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.328690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.344883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 788/1582] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:58.344883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.363141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458ef8e-fbab-4b8f-aea2-57c500b16b40 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.363505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.364190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.364473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.364751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] PATH_INFO: `/v3/projects/cc0b982cad3844b185c61ea15ded72db/users/d16eb95904c7405aa0069f37cb296682/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.383141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] MFA Rules not processed for user `807c6358457d4c5aa711abc1120953ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:58.384985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.385712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0b982cad3844b185c61ea15ded72db, user_id=d16eb95904c7405aa0069f37cb296682, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.389029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.503223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:58.503732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 795/1583] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:58.505494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.507802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 789/1584] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:58 2022] PUT /identity/v3/projects/cc0b982cad3844b185c61ea15ded72db/users/d16eb95904c7405aa0069f37cb296682/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:58.519178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7034d77-dc2f-4eab-b020-e9ee0ebf5788 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.519935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.522205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.600255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.601476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.602017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.602485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] PATH_INFO: `/v3/projects/76bff879003c46a6bb61141b62ff6a97/users/8d51c727e8674328a63b289b07e7eb52/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.621122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bff879003c46a6bb61141b62ff6a97, user_id=8d51c727e8674328a63b289b07e7eb52, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.625214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.629243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44f241-f535-40ab-8255-6ecce3df3a47 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.634583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a763-6fa5-4453-a04a-8b0e2e818f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.635209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a763-6fa5-4453-a04a-8b0e2e818f6a service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.635472 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a763-6fa5-4453-a04a-8b0e2e818f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.635989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a763-6fa5-4453-a04a-8b0e2e818f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.695385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a763-6fa5-4453-a04a-8b0e2e818f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.697295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8a763-6fa5-4453-a04a-8b0e2e818f6a service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.706663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 790/1585] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:58.707970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.708162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.708426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.739381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] MFA Rules not processed for user `d16eb95904c7405aa0069f37cb296682`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:58.740955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 796/1586] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:58 2022] PUT /identity/v3/projects/76bff879003c46a6bb61141b62ff6a97/users/8d51c727e8674328a63b289b07e7eb52/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:58.741091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.744106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.827197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 791/1587] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:58.827390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b5896-1246-4d62-8fe3-251ca5af01b9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.832440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.833048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.833322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.833776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.834421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.836391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.837515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.837940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.849586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 797/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:58.853647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.863779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f03c-1472-4cce-bbdf-ad90dca83e7d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.869840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.874329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.874329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.874329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] PATH_INFO: `/v3/projects/76bff879003c46a6bb61141b62ff6a97/users/8d51c727e8674328a63b289b07e7eb52/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.874329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bff879003c46a6bb61141b62ff6a97, user_id=8d51c727e8674328a63b289b07e7eb52, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.875758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.896072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 798/1589] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:58 2022] PUT /identity/v3/projects/76bff879003c46a6bb61141b62ff6a97/users/8d51c727e8674328a63b289b07e7eb52/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:58.896072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.956072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ec07-5310-481f-93eb-82c63574fff7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.983132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed8717-71a7-4b11-a516-ddfda57b92b0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.987393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.988150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.988496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.988843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.990714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:59.018953 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:59.019738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:59.020014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:59.020383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:59.060301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:59.062038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522d7d-b6d3-4f4b-815e-3ec289dfce76 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:59.071918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 799/1590] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:59.074846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:59.075129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:59.075398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:59.087789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:59.089761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:59.096432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:59.107036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 792/1591] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:59.107234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] MFA Rules not processed for user `8d51c727e8674328a63b289b07e7eb52`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:59.108404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:59.206206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 800/1592] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:43:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:59.250950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:59.264048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113420d7-a4a3-4a8e-b81d-f500a317d087 service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:59.267909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:59.268550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:59.268960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:59.269325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:59.279796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:59.282865 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:59.294084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 793/1593] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:59.595193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:59.606828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9eaa1-6d96-4e27-b8be-d00268f86f5a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:59.610911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:59.611822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:59.612324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:59.612670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:59.614715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:59.707975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:59.710767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1944b8-3203-4a41-ae91-5becc85f067a service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:59.722112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 801/1594] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:00.310397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:01.030580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:01.122359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e512c1a-0044-4ca9-a365-a9d3846065a1 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:01.132212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:01.132937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:01.133807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:01.134090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] PATH_INFO: `/v3/users/5246d08cd1164beeba91f1840cc2d4c9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:01.135755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5246d08cd1164beeba91f1840cc2d4c9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:01.138022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:01.343364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5246d08cd1164beeba91f1840cc2d4c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:01.344239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5246d08cd1164beeba91f1840cc2d4c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:01.383300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5246d08cd1164beeba91f1840cc2d4c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:01.527107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5246d08cd1164beeba91f1840cc2d4c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:01.542942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5246d08cd1164beeba91f1840cc2d4c9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:01.553404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 794/1595] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:01 2022] DELETE /identity/v3/users/5246d08cd1164beeba91f1840cc2d4c9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:01.558684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575828d6-3502-4f4d-99e4-b84caac60d1c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:01.565388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575828d6-3502-4f4d-99e4-b84caac60d1c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:01.565388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575828d6-3502-4f4d-99e4-b84caac60d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:01.583720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-575828d6-3502-4f4d-99e4-b84caac60d1c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:01.588231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-575828d6-3502-4f4d-99e4-b84caac60d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:01.732693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 802/1596] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:01.745070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:01.746545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:01.819248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30bdbb-8cad-417c-91b0-07fa1e5ebc35 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:01.837800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:01.838442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:01.841842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:01.841842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:01.864230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bccc05-5c8b-4c40-8690-b03e4e8ce4e1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:01.864513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bccc05-5c8b-4c40-8690-b03e4e8ce4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:01.864955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bccc05-5c8b-4c40-8690-b03e4e8ce4e1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:01.866667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 803/1597] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:44:01.870554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:01.870554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:01.887440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:01.887814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:01.888533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:01.899600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 795/1598] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:01.910924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:01.912147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:02.002175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 804/1599] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:02.016556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:02.020358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:02.042804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9f46-59c7-4e32-beb4-f3bd07fc2df7 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:02.065616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:02.066164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:02.066496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:02.066793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:02.078838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:02.080379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:02.099096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 796/1600] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:02.302685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:02.535055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:02.536552 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:02.564638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c80a6d-e176-4f40-8736-a2d6c45d19e5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:02.574775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:02.575435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:02.575748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:02.576028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] PATH_INFO: `/v3/projects/d0eeb4f38f1f47afac6c81445d0430f1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:02.577181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0eeb4f38f1f47afac6c81445d0430f1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:02.579259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:02.610517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:02.701625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0eeb4f38f1f47afac6c81445d0430f1', 'request_id': 'req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:02.711377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0eeb4f38f1f47afac6c81445d0430f1', 'request_id': 'req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:02.781461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0eeb4f38f1f47afac6c81445d0430f1', 'request_id': 'req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:02.793254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] The token cache is being invalidate because project d0eeb4f38f1f47afac6c81445d0430f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:02.793577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:02.794191 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:02.795677 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 805/1601] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:02 2022] DELETE /identity/v3/projects/d0eeb4f38f1f47afac6c81445d0430f1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:02.799673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:02.815730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ff86-c951-4546-b573-f357abb45a5c service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:02.868841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:02.869390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:02.869711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:02.869982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] PATH_INFO: `/v3/users/807c6358457d4c5aa711abc1120953ca` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:02.871104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807c6358457d4c5aa711abc1120953ca)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:02.873147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:03.105402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807c6358457d4c5aa711abc1120953ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:03.106096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807c6358457d4c5aa711abc1120953ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:03.118730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807c6358457d4c5aa711abc1120953ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:03.201727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:03.202795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807c6358457d4c5aa711abc1120953ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:03.210262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-64bee13c-6c80-47bd-85c2-fc609bc820f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807c6358457d4c5aa711abc1120953ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:03.217587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 797/1602] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:02 2022] DELETE /identity/v3/users/807c6358457d4c5aa711abc1120953ca => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:03.770583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:03.775530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:03.800193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dffd-bba3-4c5e-a204-9ae9786a7d69 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:03.870066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:03.870700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:03.870977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:03.871246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] PATH_INFO: `/v3/projects/60673667597f44d8b2643800ee13931d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:03.872542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=60673667597f44d8b2643800ee13931d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:03.874593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:03.899437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:04.003226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60673667597f44d8b2643800ee13931d', 'request_id': 'req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.011678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60673667597f44d8b2643800ee13931d', 'request_id': 'req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.090703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:04.095691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60673667597f44d8b2643800ee13931d', 'request_id': 'req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.107419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] The token cache is being invalidate because project 60673667597f44d8b2643800ee13931d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:04.107706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.108380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0f24152f-2908-4a11-a9c7-3bcd0336e5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.109891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 806/1603] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:03 2022] DELETE /identity/v3/projects/60673667597f44d8b2643800ee13931d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:04.115058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.115531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.115628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.139512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:04.140728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:04.200033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 798/1604] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:04.209247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.209846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.210125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.236679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:04.237920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:04.246512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 807/1605] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:04.250702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.261565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f76ed-00bb-4178-b0b7-dc6239f3a7d0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.266459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.267092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.267417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.267692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.270109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:04.270429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.272188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.288056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 799/1606] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:04.289854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.299630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbea4f-603a-4560-a59b-50a7d48ba56d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.304725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.308242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.308242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.308242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.308242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.308916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.441115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 808/1607] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:04.444448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.457614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f67200-8dd7-4c52-8fb5-12af652712fe admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.561197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.561899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.562178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.562449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.563135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.565013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.624448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.626956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:04.640287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a70a-ab55-4b63-a2c9-fe548d786c20 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.645507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.646267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.646630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.646961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] PATH_INFO: `/v3/users/0c6bc17d0585441690232c627d52ccbd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.648150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6bc17d0585441690232c627d52ccbd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.652737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.697303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 800/1608] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:04.701186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.714748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cddd5a-ba0a-4e47-bcb5-3a7e0e130cb9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.719970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.720728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.721108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.721494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.722232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.724383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.748847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 801/1609] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:04.752773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.765206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f392336-5557-4d64-a311-74fb2044eed4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.778123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.778123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.778123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.778123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.778553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.778553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.785725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 802/1610] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:04.790403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:04.800580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb567-a336-4ed9-954f-ad4b300e17b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:04.805786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c52ce-ee01-499f-906f-5668d2f8ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:04.806643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c52ce-ee01-499f-906f-5668d2f8ca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.806922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c52ce-ee01-499f-906f-5668d2f8ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.807217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c52ce-ee01-499f-906f-5668d2f8ca17 admin admin] PATH_INFO: `/v3/projects/9a09491d06f640c88bd4298b1d33d5b2/users/8f1abd65e79842cba7fc0f5ad3735b0e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.822309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c52ce-ee01-499f-906f-5668d2f8ca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a09491d06f640c88bd4298b1d33d5b2, user_id=8f1abd65e79842cba7fc0f5ad3735b0e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:04.825066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c52ce-ee01-499f-906f-5668d2f8ca17 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:04.853457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6bc17d0585441690232c627d52ccbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.854251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6bc17d0585441690232c627d52ccbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.867894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6bc17d0585441690232c627d52ccbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.876358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6bc17d0585441690232c627d52ccbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.877364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74a0e6cc-c874-42ab-9e14-ebc691eb7217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6bc17d0585441690232c627d52ccbd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:04.902335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 803/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:04 2022] PUT /identity/v3/projects/9a09491d06f640c88bd4298b1d33d5b2/users/8f1abd65e79842cba7fc0f5ad3735b0e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:04.912919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.913455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.913769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:04.952294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] MFA Rules not processed for user `8f1abd65e79842cba7fc0f5ad3735b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:04.953680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:04.991592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 809/1612] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:04 2022] DELETE /identity/v3/users/0c6bc17d0585441690232c627d52ccbd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:04.995930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:04.996218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:04.996490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:05.036090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:05.037383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:05.053259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:05.061698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 804/1613] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:05.087560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:05.094083 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:05.143879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 810/1614] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:05.155111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:05.157503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:05.199288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:05.242722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aff52-609e-4776-9126-93b8ac094dd4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:05.267871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b27cf-f8f8-49c0-b9ac-3ab15acb633b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:05.269222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:05.270586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:05.270866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:05.271335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:05.295020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:05.295528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:05.314180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 811/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:05.329100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:05.331032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:05.331403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:05.331977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:05.417665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:05.419856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:05.438944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 805/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:05.859315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:05.863604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:05.881379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd493d5-8207-48a3-af23-a4e935fbb6e0 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:05.894057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:05.894858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:05.895237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:05.895630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] PATH_INFO: `/v3/projects/a73f7632e1df43f18afb4cf3e15af047` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:05.898149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73f7632e1df43f18afb4cf3e15af047)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:05.900284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:06.083961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73f7632e1df43f18afb4cf3e15af047', 'request_id': 'req-c77b6fca-04ee-48c1-a62e-097fd236ca9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.105841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73f7632e1df43f18afb4cf3e15af047', 'request_id': 'req-c77b6fca-04ee-48c1-a62e-097fd236ca9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.190439 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73f7632e1df43f18afb4cf3e15af047', 'request_id': 'req-c77b6fca-04ee-48c1-a62e-097fd236ca9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.205644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] The token cache is being invalidate because project a73f7632e1df43f18afb4cf3e15af047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:06.206080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.206760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.209011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 812/1617] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:05 2022] DELETE /identity/v3/projects/a73f7632e1df43f18afb4cf3e15af047 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:06.213365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:06.231572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ede2a-5c75-4113-9aa8-1439e4dd8d4b service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:06.324841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:06.325478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:06.325790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:06.326091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] PATH_INFO: `/v3/users/ca26a652f5014de09fd00941c5566192` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:06.334513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca26a652f5014de09fd00941c5566192)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:06.337921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:06.519538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:06.577904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca26a652f5014de09fd00941c5566192'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.579055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca26a652f5014de09fd00941c5566192'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.599252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca26a652f5014de09fd00941c5566192'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.675299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca26a652f5014de09fd00941c5566192'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.675558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:06.683416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca26a652f5014de09fd00941c5566192'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:06.690609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 806/1618] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:06 2022] DELETE /identity/v3/users/ca26a652f5014de09fd00941c5566192 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:07.168045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:07.170380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:07.187993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6fca-04ee-48c1-a62e-097fd236ca9b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:07.252306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:07.253373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:07.254077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:07.254899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] PATH_INFO: `/v3/projects/d55a0fbb3181494c888819349e809ca6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:07.256292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55a0fbb3181494c888819349e809ca6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:07.258800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:07.386999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55a0fbb3181494c888819349e809ca6', 'request_id': 'req-1a87fda6-4850-459a-9497-89e1f1344264'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.393346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55a0fbb3181494c888819349e809ca6', 'request_id': 'req-1a87fda6-4850-459a-9497-89e1f1344264'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.490285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55a0fbb3181494c888819349e809ca6', 'request_id': 'req-1a87fda6-4850-459a-9497-89e1f1344264'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.517007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] The token cache is being invalidate because project d55a0fbb3181494c888819349e809ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:07.517301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.518050 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.522446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 813/1619] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:07 2022] DELETE /identity/v3/projects/d55a0fbb3181494c888819349e809ca6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:07.523611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:07.525183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:07.542256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db39230-26d2-4eb6-a876-d0ec15bf5f67 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:07.623741 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:07.624379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:07.624659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:07.624932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] PATH_INFO: `/v3/users/8d51c727e8674328a63b289b07e7eb52` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:07.626090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d51c727e8674328a63b289b07e7eb52)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:07.628033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:07.850333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d51c727e8674328a63b289b07e7eb52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.851032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d51c727e8674328a63b289b07e7eb52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.868119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:07.879324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d51c727e8674328a63b289b07e7eb52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.895080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:07.897126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:07.922435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fda6-4850-459a-9497-89e1f1344264 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:07.927297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:07.927964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:07.928240 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:07.928511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] PATH_INFO: `/v3/users/d972e042143542ef840fd53f8f70b4f6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:07.929706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d972e042143542ef840fd53f8f70b4f6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:07.933528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:07.981072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d51c727e8674328a63b289b07e7eb52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:07.997764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8875645-df61-4b16-85fb-7277c914e30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d51c727e8674328a63b289b07e7eb52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.013441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 807/1620] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:07 2022] DELETE /identity/v3/users/8d51c727e8674328a63b289b07e7eb52 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:08.020679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:08.129513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd972e042143542ef840fd53f8f70b4f6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.130203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd972e042143542ef840fd53f8f70b4f6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.147412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd972e042143542ef840fd53f8f70b4f6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.154187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd972e042143542ef840fd53f8f70b4f6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.154961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd972e042143542ef840fd53f8f70b4f6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.265245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 814/1621] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:07 2022] DELETE /identity/v3/users/d972e042143542ef840fd53f8f70b4f6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:08.276956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:08.277193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:08.277465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:08.297966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:08.299021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:08.358985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 808/1622] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:08.369940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:08.371326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:08.427320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce412-1311-4005-84c4-50242e70360e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:08.431515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c4ab-cbc2-499d-82f3-43de03d4e7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:08.432117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c4ab-cbc2-499d-82f3-43de03d4e7da service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:08.436038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c4ab-cbc2-499d-82f3-43de03d4e7da service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:08.436038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c4ab-cbc2-499d-82f3-43de03d4e7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:08.441596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c4ab-cbc2-499d-82f3-43de03d4e7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:08.443046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c4ab-cbc2-499d-82f3-43de03d4e7da service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:08.452999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 815/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:08.468599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:08.470570 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:08.483170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e459ce-c463-49a4-8111-f063827b6667 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:08.487800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:08.488470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:08.488697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:08.488970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] PATH_INFO: `/v3/projects/76bff879003c46a6bb61141b62ff6a97` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:08.490130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bff879003c46a6bb61141b62ff6a97)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:08.493661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:08.711174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bff879003c46a6bb61141b62ff6a97', 'request_id': 'req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.718146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bff879003c46a6bb61141b62ff6a97', 'request_id': 'req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.858001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bff879003c46a6bb61141b62ff6a97', 'request_id': 'req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.875371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] The token cache is being invalidate because project 76bff879003c46a6bb61141b62ff6a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:08.889321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.889321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4b529b3-7ba9-4f94-9ac1-0a15958d4ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:08.889321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 809/1624] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:08 2022] DELETE /identity/v3/projects/76bff879003c46a6bb61141b62ff6a97 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:08.891003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:08.891295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:08.891586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:08.912878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:08.914662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:08.980944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 816/1625] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:08.990845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:08.991127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:08.991401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.022129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:09.023566 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.036418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 810/1626] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:09.037281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.050700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d85b9-afe8-4e20-b96c-4bbf2041b25f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.056177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.056949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.057290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.057594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.058297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:09.058611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.060238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.074102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 817/1627] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:09.078515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.088433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80f933-7a2f-4938-b378-443947b0ce76 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.093202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.093862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.094226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.094501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.095147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.097154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.196919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 811/1628] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:09 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:09.201012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.213447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145766-aae8-4615-9816-bc9a68b2734a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.281855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.286509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.327197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.327804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.328471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.329037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.329896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.333312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.384711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961f94-6205-4398-8f50-5f83a6fa3ff0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.389527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.392724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.392724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.392724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] PATH_INFO: `/v3/projects/b5fc0789abb6446da451b8130d838e9b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.392724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fc0789abb6446da451b8130d838e9b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.393888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.419047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 818/1629] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:09 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:09.422818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.432376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cda26a-e593-4389-abb4-5d3d14567f41 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.436946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.437517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.437895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.438169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.438875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.440665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.452737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 819/1630] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:09.456779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.467357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36507824-2120-4911-9493-1313076d52e5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.479053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.479053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.479053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.479053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.479392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.479392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.485796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 820/1631] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:09.489591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.498764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8bbce-8663-452c-ad83-6b603bff11a4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.503356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876cde6-a4da-4c11-a7d0-013e5992f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.509889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876cde6-a4da-4c11-a7d0-013e5992f032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.509889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876cde6-a4da-4c11-a7d0-013e5992f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.509889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876cde6-a4da-4c11-a7d0-013e5992f032 admin admin] PATH_INFO: `/v3/projects/557b2764623146dcbf5d6e922b1abfed/users/572b8bb137304170a1e5c5d33e7953ad/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.513689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:09.520855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876cde6-a4da-4c11-a7d0-013e5992f032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557b2764623146dcbf5d6e922b1abfed, user_id=572b8bb137304170a1e5c5d33e7953ad, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.524167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876cde6-a4da-4c11-a7d0-013e5992f032 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.532699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fc0789abb6446da451b8130d838e9b', 'request_id': 'req-5f65b814-5d16-4130-8d63-ce28979dcd75'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:09.539110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fc0789abb6446da451b8130d838e9b', 'request_id': 'req-5f65b814-5d16-4130-8d63-ce28979dcd75'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:09.638092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fc0789abb6446da451b8130d838e9b', 'request_id': 'req-5f65b814-5d16-4130-8d63-ce28979dcd75'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:09.644388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 821/1632] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:09 2022] PUT /identity/v3/projects/557b2764623146dcbf5d6e922b1abfed/users/572b8bb137304170a1e5c5d33e7953ad/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:09.649964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] The token cache is being invalidate because project b5fc0789abb6446da451b8130d838e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:09.650253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:09.650930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:09.652544 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 812/1633] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:09 2022] DELETE /identity/v3/projects/b5fc0789abb6446da451b8130d838e9b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:09.656488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.657223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.657651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.658006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.662327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.688921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] MFA Rules not processed for user `572b8bb137304170a1e5c5d33e7953ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:09.690148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.738194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b814-5d16-4130-8d63-ce28979dcd75 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.770851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 822/1634] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:09.773971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:09.776267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:09.808567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.809602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.810056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.812353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] PATH_INFO: `/v3/users/68663889ee5f44c088430999ce174fad` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.814548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68663889ee5f44c088430999ce174fad)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.816649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.860645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa1431-2c79-4cfb-8cee-32d1be3efc9d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:09.865770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:09.866080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:09.866425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:09.866704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:09.867338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:09.869772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:09.975931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 823/1635] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:09 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:09.977024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.041346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6050eb-58e4-444c-b939-6a35cdb3f93a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.046257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.046891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.047164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.047432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.048148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.050137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.064249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68663889ee5f44c088430999ce174fad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.065013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68663889ee5f44c088430999ce174fad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.078893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68663889ee5f44c088430999ce174fad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.150033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 824/1636] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:09 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:10.151425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.153067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:10.165097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84297-5ce6-437d-bfc1-49c1bda15c83 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.169693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.170291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.170575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.170850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.171489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.173071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.184371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 825/1637] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:10.188418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.198331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68663889ee5f44c088430999ce174fad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.198845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ac62d-2315-46be-aad3-b54b9e010c93 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.203535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.207219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.207219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.207219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] PATH_INFO: `/v3/projects/3a7ea6c0853744f3baeac9837569cb31/users/f01d5d4e803849e08f347c2a35e87ccd/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.207456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68663889ee5f44c088430999ce174fad'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:10.214524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 813/1638] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:09 2022] DELETE /identity/v3/users/68663889ee5f44c088430999ce174fad => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:10.228074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7ea6c0853744f3baeac9837569cb31, user_id=f01d5d4e803849e08f347c2a35e87ccd, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.232402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.322768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 826/1639] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:10 2022] PUT /identity/v3/projects/3a7ea6c0853744f3baeac9837569cb31/users/f01d5d4e803849e08f347c2a35e87ccd/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:10.324283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.454681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8bba-bdea-4e39-8821-3915ae8b75d6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.521392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce4810-0ced-4233-8fb6-14ed166da885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.521998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4810-0ced-4233-8fb6-14ed166da885 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.522283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4810-0ced-4233-8fb6-14ed166da885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.523159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4810-0ced-4233-8fb6-14ed166da885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.523811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4810-0ced-4233-8fb6-14ed166da885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.525794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4810-0ced-4233-8fb6-14ed166da885 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.539087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 814/1640] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:10.541054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.551687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb21e-09ab-4b76-9da2-acd559f5f1a0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.556935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.557614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.557908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.558179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] PATH_INFO: `/v3/projects/3a7ea6c0853744f3baeac9837569cb31/users/f01d5d4e803849e08f347c2a35e87ccd/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.560076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7ea6c0853744f3baeac9837569cb31, user_id=f01d5d4e803849e08f347c2a35e87ccd, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.564686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.575707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 827/1641] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:10 2022] PUT /identity/v3/projects/3a7ea6c0853744f3baeac9837569cb31/users/f01d5d4e803849e08f347c2a35e87ccd/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:10.586094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.586464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.586814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.619672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] MFA Rules not processed for user `f01d5d4e803849e08f347c2a35e87ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:10.622703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:10.650499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:10.739221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 815/1642] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:10.753587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.755290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:10.812832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aa02d-0fc7-49f8-af9e-2af3b71b95a6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.816403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec0b4-7061-4430-a1a3-9e312b5ee603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.817008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec0b4-7061-4430-a1a3-9e312b5ee603 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.817283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec0b4-7061-4430-a1a3-9e312b5ee603 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.817562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec0b4-7061-4430-a1a3-9e312b5ee603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.827231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ec0b4-7061-4430-a1a3-9e312b5ee603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.828859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ec0b4-7061-4430-a1a3-9e312b5ee603 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:10.841055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 828/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:10.872642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:10.874220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:10.940913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf1f8-e280-400b-83ec-6577197eab8a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:10.945415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:10.946089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:10.946363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:10.946632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] PATH_INFO: `/v3/projects/97f7d01b210f48d49576beedf1e6b544` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:10.947746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f7d01b210f48d49576beedf1e6b544)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:10.949657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.080347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f7d01b210f48d49576beedf1e6b544', 'request_id': 'req-e3af17d4-b857-40b2-be0a-cc75a35e31f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.091960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f7d01b210f48d49576beedf1e6b544', 'request_id': 'req-e3af17d4-b857-40b2-be0a-cc75a35e31f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.172379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f7d01b210f48d49576beedf1e6b544', 'request_id': 'req-e3af17d4-b857-40b2-be0a-cc75a35e31f7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.195563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] The token cache is being invalidate because project 97f7d01b210f48d49576beedf1e6b544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:11.196411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.197097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e3af17d4-b857-40b2-be0a-cc75a35e31f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.198667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 816/1644] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:10 2022] DELETE /identity/v3/projects/97f7d01b210f48d49576beedf1e6b544 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:11.203400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.203811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.204147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.228532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:11.229792 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:11.299030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 829/1645] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:11.317661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.317950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.318224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.339445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:11.340741 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:11.349473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 817/1646] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:11.353346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.364356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c732af-1d22-4e32-90cc-51e589fb8424 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.370900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.371726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.372007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.372533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.373659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:11.374111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.376008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.404430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 830/1647] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:44:11.405599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.415086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655ceb-da14-4785-912f-8cd77839f12e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.434072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.434072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.434072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.434072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.434396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.434396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.500850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.502608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:11.517368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbdd05-f73a-4cff-9852-4a64bba5e8b1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.528490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.528490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.528490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.528490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] PATH_INFO: `/v3/users/572b8bb137304170a1e5c5d33e7953ad` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.528954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=572b8bb137304170a1e5c5d33e7953ad)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.529070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 818/1648] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:11.530045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.530913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.592732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3ae9e-df2b-498d-9a88-9144da879bef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.598792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.598792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.598792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.599142 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.599649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.601559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.739942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 819/1649] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:11.742810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.754062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d51f-4476-4bfc-b3aa-4ff34f8a4627 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.759041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.759786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.760119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.760390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.761038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.762923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.775293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 820/1650] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:11.779015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.783899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572b8bb137304170a1e5c5d33e7953ad'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.785279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572b8bb137304170a1e5c5d33e7953ad'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.792895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250e41-8695-47f4-a340-2f79a6145f1e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.801073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.801729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.802005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.802493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.803167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.806149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.809989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572b8bb137304170a1e5c5d33e7953ad'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.823650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 821/1651] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:11.823650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:11.825104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572b8bb137304170a1e5c5d33e7953ad'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.825957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:11.826815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-932e4b83-6349-4dc0-8caa-a24fd7916e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572b8bb137304170a1e5c5d33e7953ad'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:11.827862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:11.842842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06a373-0192-4376-8a4e-eb64c526a03f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:11.849178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e671b82-42b1-4192-98a4-3d08cc93eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:11.849978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e671b82-42b1-4192-98a4-3d08cc93eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.850335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e671b82-42b1-4192-98a4-3d08cc93eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.850681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e671b82-42b1-4192-98a4-3d08cc93eeb2 admin admin] PATH_INFO: `/v3/projects/70af7c391d2b4fe489685c54ed680956/users/9cee5960337848cbba4fe011e8f285d0/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.869384 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e671b82-42b1-4192-98a4-3d08cc93eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70af7c391d2b4fe489685c54ed680956, user_id=9cee5960337848cbba4fe011e8f285d0, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:11.873624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e671b82-42b1-4192-98a4-3d08cc93eeb2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:11.913460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 831/1652] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:11 2022] DELETE /identity/v3/users/572b8bb137304170a1e5c5d33e7953ad => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:11.918896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.919362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.919815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.950168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:11.950168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.000516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 822/1653] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:11 2022] PUT /identity/v3/projects/70af7c391d2b4fe489685c54ed680956/users/9cee5960337848cbba4fe011e8f285d0/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:12.010147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 832/1654] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:12.012514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.012993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.013512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.021053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.023650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:12.026373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.044223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] MFA Rules not processed for user `9cee5960337848cbba4fe011e8f285d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:12.045417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.082310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095d84c-9363-40c4-9e52-522e6a233bfd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.109350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 823/1655] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:12.114814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.144371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.145248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.145741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.146017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.192581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499978-3e50-4e63-8613-d13383c57093 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.197787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.198397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.198676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.198951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.199581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.201600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.206827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.208374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.218296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 833/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:12.297740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 824/1657] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:12 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:12.301776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.314106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197f149-fa89-4ceb-aee5-567576b7d4e5 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.372458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.372993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.373303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.373613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.374260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.376146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.497844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 834/1658] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:12 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:12.502041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.514197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091503-fa0a-45cf-b198-2df6466e01ac admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.519799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.520439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.520981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.521318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.522480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.524178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.537737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 825/1659] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:12.538957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.550038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551978d-a5b0-4dcb-959c-bc7b3158d4d8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.556068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.561600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.561600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.561600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] PATH_INFO: `/v3/projects/c58c20fe66bf4368ba59e25c5f014a2a/users/20c3028ff10f4d9d9d1b3a7d302b17ca/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.572218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58c20fe66bf4368ba59e25c5f014a2a, user_id=20c3028ff10f4d9d9d1b3a7d302b17ca, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.574944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.654184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.654184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.681996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e0a24-67ea-4909-bd51-9f8c2ba05441 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.688667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 835/1660] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:12 2022] PUT /identity/v3/projects/c58c20fe66bf4368ba59e25c5f014a2a/users/20c3028ff10f4d9d9d1b3a7d302b17ca/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:12.689954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.741184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.742301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.742604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.743487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] PATH_INFO: `/v3/projects/557b2764623146dcbf5d6e922b1abfed` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.744625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=557b2764623146dcbf5d6e922b1abfed)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.746585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.751640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c533a8-85c5-4f26-9c2e-0fbbc4cc68f2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.756855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.757649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.757995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.761880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.762779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.764501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.775339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 836/1661] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:12.779463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.793965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9946-c5fd-4c7e-ae33-49d09565914c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.804222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060c90-efb5-49a7-a1b3-5dc55a40f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.804931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060c90-efb5-49a7-a1b3-5dc55a40f17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.806432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060c90-efb5-49a7-a1b3-5dc55a40f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.806798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060c90-efb5-49a7-a1b3-5dc55a40f17e admin admin] PATH_INFO: `/v3/projects/c58c20fe66bf4368ba59e25c5f014a2a/users/20c3028ff10f4d9d9d1b3a7d302b17ca/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.808239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:12.809033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d060c90-efb5-49a7-a1b3-5dc55a40f17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58c20fe66bf4368ba59e25c5f014a2a, user_id=20c3028ff10f4d9d9d1b3a7d302b17ca, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.813058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d060c90-efb5-49a7-a1b3-5dc55a40f17e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.831679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 837/1662] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:12 2022] PUT /identity/v3/projects/c58c20fe66bf4368ba59e25c5f014a2a/users/20c3028ff10f4d9d9d1b3a7d302b17ca/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:12.835278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.835562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.835834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.866835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] MFA Rules not processed for user `20c3028ff10f4d9d9d1b3a7d302b17ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:12.868598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.870026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557b2764623146dcbf5d6e922b1abfed', 'request_id': 'req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:12.879989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557b2764623146dcbf5d6e922b1abfed', 'request_id': 'req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:12.956235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 838/1663] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:12.973930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557b2764623146dcbf5d6e922b1abfed', 'request_id': 'req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:12.981943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.983508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.987214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] The token cache is being invalidate because project 557b2764623146dcbf5d6e922b1abfed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:12.988770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:12.988770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:12.992760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 826/1664] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:12 2022] DELETE /identity/v3/projects/557b2764623146dcbf5d6e922b1abfed => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:12.996565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:13.008943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:13.065647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c6af1-870f-4067-930d-9b86f5e3c9f8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:13.069746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:13.070440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:13.070943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:13.071287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:13.073311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:13.092292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:13.093927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:13.104263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947a1f0-b9f1-488f-9ff6-bd3a685fe64f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:13.112037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 839/1665] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:13.115772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:13.117692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:13.118188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:13.118524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] PATH_INFO: `/v3/users/f01d5d4e803849e08f347c2a35e87ccd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:13.120129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01d5d4e803849e08f347c2a35e87ccd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:13.122866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:13.362065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01d5d4e803849e08f347c2a35e87ccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:13.372011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01d5d4e803849e08f347c2a35e87ccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:13.380581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:13.382077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:13.382381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01d5d4e803849e08f347c2a35e87ccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:13.396128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2ed90-af55-4b90-ac38-092047d1ee68 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:13.400661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:13.401271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:13.401571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:13.401881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:13.403605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:13.466982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:13.468406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:13.471973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01d5d4e803849e08f347c2a35e87ccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:13.492365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-603e24ba-0fce-4992-91a8-3242d00e0bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01d5d4e803849e08f347c2a35e87ccd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:13.493948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 840/1666] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:13.502694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 827/1667] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:12 2022] DELETE /identity/v3/users/f01d5d4e803849e08f347c2a35e87ccd => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:13.505523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:14.013226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:14.014678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:14.028320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bc33e-a2e0-4809-ad97-18d59f292e3f service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:14.105003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:14.105655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.105964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.106242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] PATH_INFO: `/v3/projects/3a7ea6c0853744f3baeac9837569cb31` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.107353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7ea6c0853744f3baeac9837569cb31)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:14.109441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:14.216873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7ea6c0853744f3baeac9837569cb31', 'request_id': 'req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:14.223678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7ea6c0853744f3baeac9837569cb31', 'request_id': 'req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:14.310722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7ea6c0853744f3baeac9837569cb31', 'request_id': 'req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:14.327083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] The token cache is being invalidate because project 3a7ea6c0853744f3baeac9837569cb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:14.327385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:14.328024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6e8d99ed-9b57-46b3-9aa5-af7ee58feaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:14.329829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 841/1668] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:14 2022] DELETE /identity/v3/projects/3a7ea6c0853744f3baeac9837569cb31 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:14.334627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.335116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.335198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.358536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:14.359774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:14.445739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 828/1669] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:14.469772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.470230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.471339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.490616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:14.493081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:14.494332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:14.502588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 842/1670] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:14.506817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:14.517310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb256e-80ab-405b-9c5e-84a6655ce50a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:14.521858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:14.522464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.522745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.523018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.523666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:14.524484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:14.526162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:14.539058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 829/1671] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:14.543776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:14.553141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415d3a-6bfd-4535-95e5-81d018c00077 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:14.558245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:14.559134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.559405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.559656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.560349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:14.562206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:14.682785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 843/1672] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:14 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:14.688301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:14.715794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4537-96a8-482d-98e3-8cbeb87c9aa2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:14.789924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:14.790537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.790818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.791092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.792374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:14.794390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:14.904643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 830/1673] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:14 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:14.908815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:14.919380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7410707-c5ec-4e24-9018-4dcbd9bd1203 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:14.923840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:14.924472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.924911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.925158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.925834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:14.927421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:14.938007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 844/1674] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:14.942105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:14.952979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad297dff-c6c6-4a63-afc9-5f22ebe25d76 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:14.957854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75816c50-38f5-4a54-84d9-d8a2deb8abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:14.964430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816c50-38f5-4a54-84d9-d8a2deb8abad admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:14.964430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816c50-38f5-4a54-84d9-d8a2deb8abad admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:14.964430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816c50-38f5-4a54-84d9-d8a2deb8abad admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:14.964430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75816c50-38f5-4a54-84d9-d8a2deb8abad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:14.964430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75816c50-38f5-4a54-84d9-d8a2deb8abad admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:14.993016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 831/1675] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:14.997905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:15.021954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0bb0-0aef-4bbd-a162-6358cbaff71b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:15.029760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:15.030750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:15.031207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:15.031655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] PATH_INFO: `/v3/projects/924ad2f1f1b24f95a2b1d96fc9a4deb9/users/4d79dd33e88e48199c45b60bd5327759/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:15.052466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924ad2f1f1b24f95a2b1d96fc9a4deb9, user_id=4d79dd33e88e48199c45b60bd5327759, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:15.056230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:15.176620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 845/1676] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:14 2022] PUT /identity/v3/projects/924ad2f1f1b24f95a2b1d96fc9a4deb9/users/4d79dd33e88e48199c45b60bd5327759/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:15.182656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca361-5e2c-4659-8515-e4f1cb32fafb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:15.185511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca361-5e2c-4659-8515-e4f1cb32fafb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:15.185511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca361-5e2c-4659-8515-e4f1cb32fafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:15.204718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9c7ca361-5e2c-4659-8515-e4f1cb32fafb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:15.206273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c7ca361-5e2c-4659-8515-e4f1cb32fafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:15.266133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:15.330904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 832/1677] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:15.337952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:15.339833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:15.407737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0609-1b14-487e-a773-d34ed59c84c2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:15.411676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:15.412445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:15.412836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:15.413202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:15.428096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:15.429826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:15.446475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 846/1678] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:16.400972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:17.083222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.083528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.083828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.096562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:17.114371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] MFA Rules not processed for user `4d79dd33e88e48199c45b60bd5327759`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:17.115637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:17.197707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 833/1679] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:17.200636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.210507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becbd43-593e-4c7d-a568-13e6efbf2677 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.215462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.216107 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.216335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.216604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.217232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.219156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.339106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 847/1680] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:17 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:17.343172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.356106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4deb0c-0f99-4c21-b1d0-9ddfa8b1211a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.377040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.378870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:17.449217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.452418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.452839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.453611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.454914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.458091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.519077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21363-6da6-428b-a2b7-9c75d4c57270 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.537734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.538362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.538649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.539043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] PATH_INFO: `/v3/users/9cee5960337848cbba4fe011e8f285d0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.540315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cee5960337848cbba4fe011e8f285d0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.542443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.575626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 834/1681] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:17 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:17.581931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.592571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71090-58b8-434f-b638-8e0b931d86ce admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.597660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.598341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.598695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.599042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.599755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.602183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.616519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 835/1682] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:17.620302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.631503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83caec-b82c-4c8b-91b7-3497ee62bd2e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.636988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.637804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.638153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.638501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] PATH_INFO: `/v3/projects/43e83bd3e25f41de83a5516ebbf59735/users/a6a1bdabcdda499390a75fe743917fb9/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.653778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e83bd3e25f41de83a5516ebbf59735, user_id=a6a1bdabcdda499390a75fe743917fb9, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.656477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.743698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 836/1683] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:17 2022] PUT /identity/v3/projects/43e83bd3e25f41de83a5516ebbf59735/users/a6a1bdabcdda499390a75fe743917fb9/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:17.747617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.776395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cee5960337848cbba4fe011e8f285d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:17.777341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cee5960337848cbba4fe011e8f285d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:17.792489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cee5960337848cbba4fe011e8f285d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:17.814031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cee5960337848cbba4fe011e8f285d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:17.814825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1184b928-cf57-4f8a-99e0-9ddd5b3b2152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cee5960337848cbba4fe011e8f285d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:17.821786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e127-edd2-457e-96e9-028288ca8859 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.829976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.830670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.834783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.834783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.834783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.836583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.857871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 837/1684] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:17.858810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.860694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:17.876782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ab106-a228-4d79-a398-74553c3090bd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:17.881690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:17.882373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.882638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.882946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] PATH_INFO: `/v3/projects/43e83bd3e25f41de83a5516ebbf59735/users/a6a1bdabcdda499390a75fe743917fb9/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.884982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e83bd3e25f41de83a5516ebbf59735, user_id=a6a1bdabcdda499390a75fe743917fb9, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:17.888373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:17.893093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 848/1685] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:17 2022] DELETE /identity/v3/users/9cee5960337848cbba4fe011e8f285d0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:17.897680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:17.897971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:17.898247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:17.903334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 838/1686] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:17 2022] PUT /identity/v3/projects/43e83bd3e25f41de83a5516ebbf59735/users/a6a1bdabcdda499390a75fe743917fb9/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:17.917923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:17.919125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:17.952845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:17.985965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 849/1687] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:17.996961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:17.998845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:18.097767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07544a-9d7c-4f16-b8aa-2744a45f1be2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:18.108158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:18.108734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:18.109532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:18.109532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:18.120661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:18.122126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:18.132340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 839/1688] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:18.581202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:18.583117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:18.596257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54305978-e431-4aec-9b78-2b6831ea0b36 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:18.601812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:18.602800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:18.603156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:18.603411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] PATH_INFO: `/v3/projects/70af7c391d2b4fe489685c54ed680956` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:18.606801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70af7c391d2b4fe489685c54ed680956)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:18.608814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:18.767180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:18.937973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70af7c391d2b4fe489685c54ed680956', 'request_id': 'req-fbc17e35-939a-4072-8c24-a3b90554469b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:18.946587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70af7c391d2b4fe489685c54ed680956', 'request_id': 'req-fbc17e35-939a-4072-8c24-a3b90554469b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.078596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70af7c391d2b4fe489685c54ed680956', 'request_id': 'req-fbc17e35-939a-4072-8c24-a3b90554469b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.095422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] The token cache is being invalidate because project 70af7c391d2b4fe489685c54ed680956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:19.095942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.097705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fbc17e35-939a-4072-8c24-a3b90554469b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.103056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 850/1689] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:18 2022] DELETE /identity/v3/projects/70af7c391d2b4fe489685c54ed680956 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:19.103808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:19.115914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce305bd-5cfb-47bb-bfa1-4f8614368389 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:19.149473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:19.190115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:19.190939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:19.191290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:19.191636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] PATH_INFO: `/v3/users/20c3028ff10f4d9d9d1b3a7d302b17ca` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:19.193004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c3028ff10f4d9d9d1b3a7d302b17ca)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:19.195107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:19.512101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c3028ff10f4d9d9d1b3a7d302b17ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.512776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c3028ff10f4d9d9d1b3a7d302b17ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.525702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c3028ff10f4d9d9d1b3a7d302b17ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.629966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c3028ff10f4d9d9d1b3a7d302b17ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.649939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:19.650465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:19.650764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:19.653834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-573f7aee-33f3-400f-afe0-bc739af1e654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c3028ff10f4d9d9d1b3a7d302b17ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:19.665181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 840/1690] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:19 2022] DELETE /identity/v3/users/20c3028ff10f4d9d9d1b3a7d302b17ca => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:19.696718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] MFA Rules not processed for user `a6a1bdabcdda499390a75fe743917fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:19.700133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:19.811008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 851/1691] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:19.821471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:19.822162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:19.822666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:19.868506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] MFA Rules not processed for user `4d79dd33e88e48199c45b60bd5327759`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:19.869779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:19.964111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 841/1692] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:19.971524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:19.973195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:20.072232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3caf29-5f91-43c3-af3d-7af097adc618 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:20.082332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:20.083310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:20.083857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:20.084178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:20.086752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:20.103952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:20.106293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49e8dd-6291-49ac-8276-65f25e3e05e8 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:20.121364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 852/1693] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:20.282756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:20.284859 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:20.441060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9ec21-2ccf-43da-9bea-8cfa0560d00c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:20.447655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:20.448359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:20.448699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:20.449034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] PATH_INFO: `/v3/projects/c58c20fe66bf4368ba59e25c5f014a2a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:20.450251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58c20fe66bf4368ba59e25c5f014a2a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:20.452205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:20.460889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:20.565161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:20.584458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58c20fe66bf4368ba59e25c5f014a2a', 'request_id': 'req-1476db9e-ed41-4768-a8d1-7dbd004388e6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:20.596166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58c20fe66bf4368ba59e25c5f014a2a', 'request_id': 'req-1476db9e-ed41-4768-a8d1-7dbd004388e6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:20.660558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58c20fe66bf4368ba59e25c5f014a2a', 'request_id': 'req-1476db9e-ed41-4768-a8d1-7dbd004388e6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:20.672754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] The token cache is being invalidate because project c58c20fe66bf4368ba59e25c5f014a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:20.673044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:20.673762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1476db9e-ed41-4768-a8d1-7dbd004388e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:20.675626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 842/1694] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:20 2022] DELETE /identity/v3/projects/c58c20fe66bf4368ba59e25c5f014a2a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:20.681231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:20.681745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:20.681908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:20.702887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:20.704667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:20.767124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 853/1695] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:20.775607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:20.775913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:20.776202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:20.801578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:20.802910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:20.813024 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 843/1696] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:20.822788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:20.836237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f497af2-a37c-4f2f-90ad-7f5c98cd29d9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:20.843257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:20.844253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:20.844588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:20.845037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:20.851921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:20.851921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:20.851921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:20.861450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 854/1697] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:20.866118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:20.876799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8c260-b04f-4620-85c8-f258659b7595 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:20.882566 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:20.883294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:20.883671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:20.884371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:20.884767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:20.886879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:21.030137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 844/1698] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:20 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:21.030410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:21.038429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493e87d-dbbb-4b72-a860-29e43f747848 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:21.132736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:21.134232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:21.134961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:21.135417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:21.136121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:21.138352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:21.222702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 855/1699] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:21 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:21.227834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:21.238474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4a8ac-d710-46ed-bb9b-071400b5ff30 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:21.243243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:21.243860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:21.244117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:21.244389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:21.245034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:21.246649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:21.257095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 845/1700] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:21.261201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:21.271184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebe5df-b188-439c-99af-ed615908c953 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:21.276265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba0487-7b75-4395-a8d9-f43faa7a2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:21.276863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0487-7b75-4395-a8d9-f43faa7a2759 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:21.277141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0487-7b75-4395-a8d9-f43faa7a2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:21.277413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0487-7b75-4395-a8d9-f43faa7a2759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:21.278160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba0487-7b75-4395-a8d9-f43faa7a2759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:21.279745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba0487-7b75-4395-a8d9-f43faa7a2759 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:21.292179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 856/1701] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:21.296562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:21.307309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b65cb6-294a-43bf-80dc-7f135ee6b615 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:21.312936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:21.313629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:21.313909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:21.314181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] PATH_INFO: `/v3/projects/565bf59e01ae4d28a878be113ee976be/users/7d797cf8982b425382c6d97eb16f6461/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:21.329321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565bf59e01ae4d28a878be113ee976be, user_id=7d797cf8982b425382c6d97eb16f6461, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:21.332039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:21.383607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:21.436833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 846/1702] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:21 2022] PUT /identity/v3/projects/565bf59e01ae4d28a878be113ee976be/users/7d797cf8982b425382c6d97eb16f6461/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:21.449342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:21.644067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:21.644067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:21.644067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] MFA Rules not processed for user `7d797cf8982b425382c6d97eb16f6461`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:21.644067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:21.644067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 857/1703] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:21.645137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:21.705464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2bf75-ba4d-4271-98fe-ef9b7903b3f6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:21.710413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:21.716755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:21.716755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:21.716755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:21.716755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:21.716755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:22.089197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:22.218238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 847/1704] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:21 2022] POST /identity/v3/projects => generated 393 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:22.222709 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:22.234047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65510-70f6-4a49-9bb7-aaae742317bc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:22.302157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:22.302774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.303048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.303600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:22.305297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:22.307450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:22.447294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 858/1705] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:22 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:22.451659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:22.462176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8050395-c050-4f2c-a2c5-7b008ab7db1f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:22.467128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:22.467740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.468002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.468270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:22.468899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:22.470535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:22.481931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 848/1706] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:22.486243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:22.497207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaccd9-39c9-40a3-84c0-ca918b4fcf87 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:22.502129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:22.507667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.507667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.507667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] PATH_INFO: `/v3/projects/476133dd0d3a473289e0b1f8f7136159/users/67834e8ab35048e7b419d0eeec5ef147/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:22.518662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476133dd0d3a473289e0b1f8f7136159, user_id=67834e8ab35048e7b419d0eeec5ef147, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:22.521358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:22.662444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 859/1707] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:22 2022] PUT /identity/v3/projects/476133dd0d3a473289e0b1f8f7136159/users/67834e8ab35048e7b419d0eeec5ef147/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:22.667026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:22.676717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ee95-100e-4594-af82-aa3a31795340 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:22.737771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49614a9-9fcb-485f-b622-445c7d7b9053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:22.738531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49614a9-9fcb-485f-b622-445c7d7b9053 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.738872 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49614a9-9fcb-485f-b622-445c7d7b9053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.739078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49614a9-9fcb-485f-b622-445c7d7b9053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:22.739707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49614a9-9fcb-485f-b622-445c7d7b9053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:22.741294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49614a9-9fcb-485f-b622-445c7d7b9053 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:22.755733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 849/1708] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:22.757164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:22.769138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b1e0b-6098-42e1-9fe6-2baa31697043 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:22.775070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:22.775879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.776227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.776567 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] PATH_INFO: `/v3/projects/476133dd0d3a473289e0b1f8f7136159/users/67834e8ab35048e7b419d0eeec5ef147/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:22.779229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476133dd0d3a473289e0b1f8f7136159, user_id=67834e8ab35048e7b419d0eeec5ef147, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:22.782204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:22.801200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 860/1709] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:22 2022] PUT /identity/v3/projects/476133dd0d3a473289e0b1f8f7136159/users/67834e8ab35048e7b419d0eeec5ef147/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:22.811960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.812249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.812542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:22.849413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] MFA Rules not processed for user `67834e8ab35048e7b419d0eeec5ef147`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:22.850844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:22.922158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 850/1710] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:22.934499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:22.935143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:22.986508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:22.992817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ec920-f61e-4fb4-8f53-ff7d213a8e95 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:22.996375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:22.996967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:22.997246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:22.997517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:23.006543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:23.008548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:23.018238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 861/1711] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:23.066756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:23.068124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:23.081330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c2e2-b745-4c95-8115-cc3438e4fc0e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:23.085077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f13bf-1448-4dc1-a3cd-b64371bf8713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:23.085748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f13bf-1448-4dc1-a3cd-b64371bf8713 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:23.086572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f13bf-1448-4dc1-a3cd-b64371bf8713 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:23.086866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f13bf-1448-4dc1-a3cd-b64371bf8713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:23.152222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f13bf-1448-4dc1-a3cd-b64371bf8713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:23.153821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f13bf-1448-4dc1-a3cd-b64371bf8713 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:23.167453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 851/1712] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:23.760289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:24.352302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.176914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.268349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.325092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:25.326534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:25.338219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.389586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.412214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affba559-0330-4c83-be83-3884341aa1da service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:25.417800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:25.418434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:25.418710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:25.418986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] PATH_INFO: `/v3/users/d16eb95904c7405aa0069f37cb296682` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:25.420092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16eb95904c7405aa0069f37cb296682)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:25.422074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:25.680073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.693299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16eb95904c7405aa0069f37cb296682'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:25.694122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16eb95904c7405aa0069f37cb296682'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:25.706362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16eb95904c7405aa0069f37cb296682'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:25.713852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16eb95904c7405aa0069f37cb296682'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:25.714625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16eb95904c7405aa0069f37cb296682'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:25.814657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:25.843775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 862/1713] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:25 2022] DELETE /identity/v3/users/d16eb95904c7405aa0069f37cb296682 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:25.848894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:25.849178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:25.849448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:25.869048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:25.870263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:25.928889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 852/1714] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:25.938514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:25.939977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:26.000324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc3166-b3dc-43ad-a9a0-b717896f5cf3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:26.004359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11f14-944d-4039-80b2-dfde4533ea72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:26.004973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11f14-944d-4039-80b2-dfde4533ea72 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:26.005261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11f14-944d-4039-80b2-dfde4533ea72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:26.005606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11f14-944d-4039-80b2-dfde4533ea72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:26.016572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11f14-944d-4039-80b2-dfde4533ea72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:26.021227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11f14-944d-4039-80b2-dfde4533ea72 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:26.029095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 863/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:26.455456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:26.462891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:26.464757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:26.495585 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeabd7-a474-407b-aad3-be50ee1a09fd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:26.502379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:26.503183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:26.503732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:26.504144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] PATH_INFO: `/v3/projects/cc0b982cad3844b185c61ea15ded72db` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:26.505993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0b982cad3844b185c61ea15ded72db)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:26.509113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:26.654979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:26.673473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0b982cad3844b185c61ea15ded72db', 'request_id': 'req-34a503bd-acec-46fa-ae7a-9cb348c75ecc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:26.683467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0b982cad3844b185c61ea15ded72db', 'request_id': 'req-34a503bd-acec-46fa-ae7a-9cb348c75ecc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:26.765510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0b982cad3844b185c61ea15ded72db', 'request_id': 'req-34a503bd-acec-46fa-ae7a-9cb348c75ecc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:26.777730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] The token cache is being invalidate because project cc0b982cad3844b185c61ea15ded72db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:26.778072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:26.778722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-34a503bd-acec-46fa-ae7a-9cb348c75ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:26.780238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 853/1716] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:26 2022] DELETE /identity/v3/projects/cc0b982cad3844b185c61ea15ded72db => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:26.785184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:26.785473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:26.785779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:26.808132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:26.809324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:26.870618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:26.974023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 864/1717] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:26.984845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:26.984845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:26.984845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.019143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:27.020698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:27.032713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 854/1718] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:27.033750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.046166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d9b01-7a1f-4267-a7ec-557f4f7a2cd1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.051777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.052797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.053151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.053509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.059248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:27.059248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.059248 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:27.077036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 865/1719] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:44:27.085003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.115670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c218-efb5-4fd6-963e-3438bd2724d6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.126997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.127951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.128436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.128918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.129798 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.132532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:27.197699 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:27.248886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 855/1720] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:27 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:27.250832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.261741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a85f-56f1-48f7-8add-a942268a2454 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.341244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.341934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.342223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.342498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.343148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.346047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:27.439710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 866/1721] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:27 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:27.443902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.454668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969d54-5b19-49aa-8311-2dd8ba34264c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.459416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.460009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.460377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.460687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.463202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.465122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:27.478467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 856/1722] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:27.489083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.496891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f917b-982b-41ff-8fe5-b19085a8014e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.502612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a636b-bd73-472a-84c8-df8f5335721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.503322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a636b-bd73-472a-84c8-df8f5335721b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.503697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a636b-bd73-472a-84c8-df8f5335721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.504069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a636b-bd73-472a-84c8-df8f5335721b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.504775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a636b-bd73-472a-84c8-df8f5335721b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.507420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a636b-bd73-472a-84c8-df8f5335721b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:27.532431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 867/1723] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:27.532942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.547123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:27.552098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cd3e8-f536-4b55-b3f4-9e156d11b577 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.558965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.559835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.560221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.560586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] PATH_INFO: `/v3/projects/9ff053960661433aa17b8fcfe8352c4b/users/b7a175d3729548978ba7af5070ef6da6/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.578920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff053960661433aa17b8fcfe8352c4b, user_id=b7a175d3729548978ba7af5070ef6da6, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.582000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:27.744659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 857/1724] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:27 2022] PUT /identity/v3/projects/9ff053960661433aa17b8fcfe8352c4b/users/b7a175d3729548978ba7af5070ef6da6/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:27.756105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.756395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.756668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.790732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] MFA Rules not processed for user `b7a175d3729548978ba7af5070ef6da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:27.792574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:27.858585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 868/1725] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:27.863069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:27.964433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecb7c5-1ef4-4692-9b50-30f48c8762b6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:27.977193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:27.977880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:27.978162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:27.978436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:27.979148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:27.981111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.070195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 858/1726] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:27 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:28.074415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.088741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e3719-34c5-4ae9-a814-4f30f79a4672 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.174972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.175921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.176301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.176636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.177591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.180134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.315511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 869/1727] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:28 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:28.324296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.331646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335892ad-cede-453a-a69e-fe393d888dc5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.338630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.339313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.340036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.340336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.347797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.351986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.363078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 859/1728] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:28.367170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.378528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a929-26b9-49fb-b097-521ad7efac9f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.383744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae4184-5ee0-4e55-b041-b96330af7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.389478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae4184-5ee0-4e55-b041-b96330af7b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.389478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae4184-5ee0-4e55-b041-b96330af7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.389478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae4184-5ee0-4e55-b041-b96330af7b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.389478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae4184-5ee0-4e55-b041-b96330af7b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.389478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae4184-5ee0-4e55-b041-b96330af7b4e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.398687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 870/1729] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:28.406563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.417499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6deeee-9868-443f-a1b2-6e76c81a7d0b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.423082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.423853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.424114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.424634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] PATH_INFO: `/v3/projects/e3b651da88b343ac8176c98dca54665f/users/61bb83f46fd743b39e466eccc5a1ce4c/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.440713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b651da88b343ac8176c98dca54665f, user_id=61bb83f46fd743b39e466eccc5a1ce4c, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.443845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.552525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 860/1730] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:28 2022] PUT /identity/v3/projects/e3b651da88b343ac8176c98dca54665f/users/61bb83f46fd743b39e466eccc5a1ce4c/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:28.565360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.565879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.567279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.598791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] MFA Rules not processed for user `61bb83f46fd743b39e466eccc5a1ce4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:28.600005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:28.658121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:28.676229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 871/1731] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:28.681628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.748451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1e90-4474-45a6-971e-580f55f9c296 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.754330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.754502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.754680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.759561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.759561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.759561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.798506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.800436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:28.816758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bef3f-29ae-4f04-b688-7c37dba493c5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.822798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.823710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.824154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.824578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] PATH_INFO: `/v3/users/7d797cf8982b425382c6d97eb16f6461` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.825935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d797cf8982b425382c6d97eb16f6461)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.827862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:28.865786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 861/1732] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:28 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:28.869222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:28.895530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:28.933062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c858d3-f41d-4d7a-a2cd-f77f03661416 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:28.937581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:28.938226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:28.938499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:28.938768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:28.939398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:28.941284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.045785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d797cf8982b425382c6d97eb16f6461'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:29.046447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d797cf8982b425382c6d97eb16f6461'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:29.058860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d797cf8982b425382c6d97eb16f6461'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:29.066132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 862/1733] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:28 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:29.066853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d797cf8982b425382c6d97eb16f6461'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:29.067551 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-773137c0-ac10-438c-92c4-d7cefd35ef5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d797cf8982b425382c6d97eb16f6461'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:29.070359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.072042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.084794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeaedf-01e7-4f71-bf2e-c7a68d6abfd7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.090279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.095542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.095542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.095542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.095542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.095542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.104472 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 863/1734] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:29.108557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.118440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d7f2-d23b-4029-99e8-16b06e6532f5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.123481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.124115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.124388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.124658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] PATH_INFO: `/v3/projects/1b97cbe4ea5e4c23b90237cea87af082/users/ad873f4316bd4dbbaf8f03f3b2f56061/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.139660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b97cbe4ea5e4c23b90237cea87af082, user_id=ad873f4316bd4dbbaf8f03f3b2f56061, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.142376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.171105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 872/1735] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:28 2022] DELETE /identity/v3/users/7d797cf8982b425382c6d97eb16f6461 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:29.175506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.175887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.176095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.197790 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:29.199153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.218833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 864/1736] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:29 2022] PUT /identity/v3/projects/1b97cbe4ea5e4c23b90237cea87af082/users/ad873f4316bd4dbbaf8f03f3b2f56061/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:29.223970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.293026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 873/1737] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:29.326631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013ca94-b2dc-4650-a02e-5298501d7b6b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.331589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.333160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.333160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.333160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.334238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.334982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.341628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.344067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.347959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 865/1738] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:29.352223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.365455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65b082-1317-4edb-a1bf-ad00712ecfcf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.370874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06243a-806e-4372-a186-0d1452adeb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.371647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06243a-806e-4372-a186-0d1452adeb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.371928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06243a-806e-4372-a186-0d1452adeb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.372257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06243a-806e-4372-a186-0d1452adeb11 admin admin] PATH_INFO: `/v3/projects/1b97cbe4ea5e4c23b90237cea87af082/users/ad873f4316bd4dbbaf8f03f3b2f56061/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.375437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06243a-806e-4372-a186-0d1452adeb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b97cbe4ea5e4c23b90237cea87af082, user_id=ad873f4316bd4dbbaf8f03f3b2f56061, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.376842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06243a-806e-4372-a186-0d1452adeb11 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.394889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 866/1739] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:29 2022] PUT /identity/v3/projects/1b97cbe4ea5e4c23b90237cea87af082/users/ad873f4316bd4dbbaf8f03f3b2f56061/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:29.406126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.406450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.406683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.438701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] MFA Rules not processed for user `ad873f4316bd4dbbaf8f03f3b2f56061`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:29.439827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.454187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004d8a-c1d0-4f4e-be05-6dbb5ae1f972 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.557843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 867/1740] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:29.578408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.579953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.580249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.580521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.641682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.643423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.678237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.680402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.701658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 874/1741] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:29.708026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53610b75-8035-4ed7-b876-1848cb5aa13a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.712410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.713155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.714710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.715098 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.717374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.788838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:29.822891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.824767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.840201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 868/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:30.201224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:30.202740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:30.216258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d3670-5e83-4ebd-9109-3a67715bea4f service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:30.223650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:30.224292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:30.224598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:30.224828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] PATH_INFO: `/v3/projects/565bf59e01ae4d28a878be113ee976be` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:30.226825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565bf59e01ae4d28a878be113ee976be)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:30.228669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:30.328742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565bf59e01ae4d28a878be113ee976be', 'request_id': 'req-9b21cdc3-b0d1-4474-a2b0-11664b577b77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.335804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565bf59e01ae4d28a878be113ee976be', 'request_id': 'req-9b21cdc3-b0d1-4474-a2b0-11664b577b77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.398600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:30.399424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565bf59e01ae4d28a878be113ee976be', 'request_id': 'req-9b21cdc3-b0d1-4474-a2b0-11664b577b77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.410676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] The token cache is being invalidate because project 565bf59e01ae4d28a878be113ee976be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:30.410964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.411594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.413143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 875/1743] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:30 2022] DELETE /identity/v3/projects/565bf59e01ae4d28a878be113ee976be => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:30.417676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:30.428582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabcfc-73cd-4fdd-9835-13e5d328058c service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:30.512891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:30.513563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:30.513858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:30.514227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] PATH_INFO: `/v3/users/67834e8ab35048e7b419d0eeec5ef147` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:30.515548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67834e8ab35048e7b419d0eeec5ef147)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:30.518223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:30.828708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67834e8ab35048e7b419d0eeec5ef147'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.832806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67834e8ab35048e7b419d0eeec5ef147'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.842436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67834e8ab35048e7b419d0eeec5ef147'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.983315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67834e8ab35048e7b419d0eeec5ef147'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:30.999542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67834e8ab35048e7b419d0eeec5ef147'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.006049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 869/1744] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:30 2022] DELETE /identity/v3/users/67834e8ab35048e7b419d0eeec5ef147 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:31.100039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:31.289268 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:31.291284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.304880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21cdc3-b0d1-4474-a2b0-11664b577b77 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:31.362879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:31.363514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.363794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.364076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] PATH_INFO: `/v3/users/8f1abd65e79842cba7fc0f5ad3735b0e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.365218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1abd65e79842cba7fc0f5ad3735b0e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:31.367333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:31.475708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:31.477180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.492104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f9bc-b0f7-491d-afc1-791cb8f3f596 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:31.497028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:31.497712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.497991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.498269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] PATH_INFO: `/v3/projects/476133dd0d3a473289e0b1f8f7136159` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.499390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=476133dd0d3a473289e0b1f8f7136159)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:31.501533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:31.590968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1abd65e79842cba7fc0f5ad3735b0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.591616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1abd65e79842cba7fc0f5ad3735b0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.604677 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1abd65e79842cba7fc0f5ad3735b0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.612421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1abd65e79842cba7fc0f5ad3735b0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.613996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad389206-07d3-400f-8b83-f346acdc8aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1abd65e79842cba7fc0f5ad3735b0e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.617188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476133dd0d3a473289e0b1f8f7136159', 'request_id': 'req-c82bc39c-e4c4-4967-830c-99b637409d3b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.623798 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476133dd0d3a473289e0b1f8f7136159', 'request_id': 'req-c82bc39c-e4c4-4967-830c-99b637409d3b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.705257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 876/1745] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:31 2022] DELETE /identity/v3/users/8f1abd65e79842cba7fc0f5ad3735b0e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:31.709630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.709933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.710344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.730222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:31.731470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.789174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476133dd0d3a473289e0b1f8f7136159', 'request_id': 'req-c82bc39c-e4c4-4967-830c-99b637409d3b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.789899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 877/1746] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:31.800935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:31.802288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.804919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] The token cache is being invalidate because project 476133dd0d3a473289e0b1f8f7136159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:31.807072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.807072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c82bc39c-e4c4-4967-830c-99b637409d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:31.807597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 870/1747] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:31 2022] DELETE /identity/v3/projects/476133dd0d3a473289e0b1f8f7136159 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:31.812400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f37b-18f9-405e-a669-95b902fb83d1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.812796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f37b-18f9-405e-a669-95b902fb83d1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.813190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f37b-18f9-405e-a669-95b902fb83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.834069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3bf5f37b-18f9-405e-a669-95b902fb83d1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:31.835396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3bf5f37b-18f9-405e-a669-95b902fb83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.846150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 871/1748] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:31.854956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.855518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.856012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.868416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c67a1-0621-47bf-b8c2-710578afee88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:31.875022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:31.875022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.875260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.875541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.877565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.878023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:31.879547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:31.889055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 872/1749] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:31.891908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:31.894311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:31.895802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:31.897722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:31.906323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 878/1750] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:31.913087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d10c3-80d1-49d9-8aff-d946be4e3d3b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:31.918090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:31.918709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.918988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.919252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.919902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:31.920200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:31.921797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:31.938550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 873/1751] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:31.943033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:31.956108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464605-b6e5-4c91-a46b-c5a0663f9153 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:31.967448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:31.968555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:31.968893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:31.969116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:31.970129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:31.972646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.092479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 879/1752] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:31 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:32.092821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.105618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be602-58d4-4cce-8e2e-cc1d08f6d6fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.185042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.185777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.186129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.186565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.187312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.189285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.318669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 874/1753] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:32 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:32.323025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.333420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b98d8-a16b-4b6f-a4f1-03ba71479637 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.340226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.342079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.344102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.344102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.344102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.345604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.358143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 880/1754] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:32.362582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.373130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f91d5-7383-467e-8855-6c3be17326a8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.378111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.378650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.378949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.379214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.379858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.381460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.392667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 875/1755] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:32.396952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.407667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6bf2e-1238-4f07-a785-bc6e44d17f01 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.412680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4c99-adf9-4e82-b42a-3c4f6ce71e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.413390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4c99-adf9-4e82-b42a-3c4f6ce71e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.414271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4c99-adf9-4e82-b42a-3c4f6ce71e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.414537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4c99-adf9-4e82-b42a-3c4f6ce71e55 admin admin] PATH_INFO: `/v3/projects/16e03e77aee3421a993880cdbe5935d6/users/2429833db2a14df48e8a4486adfb456e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.429188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4c99-adf9-4e82-b42a-3c4f6ce71e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e03e77aee3421a993880cdbe5935d6, user_id=2429833db2a14df48e8a4486adfb456e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.431881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4c99-adf9-4e82-b42a-3c4f6ce71e55 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.446995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.448854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.465149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac630ae-767a-4163-9d79-db04bd491d81 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.471839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.473116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.473116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.473336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] PATH_INFO: `/v3/projects/9a09491d06f640c88bd4298b1d33d5b2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.474607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a09491d06f640c88bd4298b1d33d5b2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.477316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.498300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 881/1756] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:32 2022] PUT /identity/v3/projects/16e03e77aee3421a993880cdbe5935d6/users/2429833db2a14df48e8a4486adfb456e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:32.508863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.509151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.509432 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.539970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] MFA Rules not processed for user `2429833db2a14df48e8a4486adfb456e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:32.541412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.612323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 882/1757] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:32.623568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a09491d06f640c88bd4298b1d33d5b2', 'request_id': 'req-1fece67d-9d80-405c-a0b9-71db6857cc63'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:32.630501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a09491d06f640c88bd4298b1d33d5b2', 'request_id': 'req-1fece67d-9d80-405c-a0b9-71db6857cc63'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:32.649338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.650365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.723302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867746b9-907e-4eac-a778-52d9a8272382 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.723720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a09491d06f640c88bd4298b1d33d5b2', 'request_id': 'req-1fece67d-9d80-405c-a0b9-71db6857cc63'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:32.737425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] The token cache is being invalidate because project 9a09491d06f640c88bd4298b1d33d5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:32.737750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:32.738639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fece67d-9d80-405c-a0b9-71db6857cc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:32.740370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 876/1758] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:32 2022] DELETE /identity/v3/projects/9a09491d06f640c88bd4298b1d33d5b2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:32.745434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657369f-5c96-49f3-b593-ab99875322e9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.746048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657369f-5c96-49f3-b593-ab99875322e9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.746415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657369f-5c96-49f3-b593-ab99875322e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.764629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:32.770400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5657369f-5c96-49f3-b593-ab99875322e9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:32.771829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5657369f-5c96-49f3-b593-ab99875322e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.786527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.787441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.787725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.788002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.789986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.854764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 877/1759] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:32.864519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.864674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.864776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.864975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.865783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.876811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 883/1760] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:44:32.893864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:32.895094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:32.919788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 878/1761] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:32.924205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.937597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e87df9-65f8-48a2-8fc7-db465384b687 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.943532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:32.944148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:32.944433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:32.945222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:32.945958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:32.946270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:32.948100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:32.972909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 884/1762] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:32.977075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:32.995125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f72938-193d-42ad-b452-b742b80c0b7c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:32.998237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:33.001058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:33.005216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.005868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.006814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.006814 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.007792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.009642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.019908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8319428-89c8-4e01-a563-3a2994f2d444 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:33.027739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.029576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.030073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.035580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.037801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:33.109766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 879/1763] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:32 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:33.112507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:33.136242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.137418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.149049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 885/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:33.195591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:33.217110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80facf2-a74b-41c7-90fc-3ff6545d033f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:33.222562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.223479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.223861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.224234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.224970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.227181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.379192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 880/1765] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:33 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:33.380364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:33.398596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe12a2f-c3de-4814-b18e-0c4f7558d22c service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:33.403544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.404153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.404435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.404707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.405345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.407272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.430918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 886/1766] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:33.432215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:33.444086 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1ebd-46f2-4a8f-a616-276f9cb1ed81 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:33.449445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ceb968-fa54-4b54-862c-e246dca0bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.450129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceb968-fa54-4b54-862c-e246dca0bff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.450410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceb968-fa54-4b54-862c-e246dca0bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.450681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceb968-fa54-4b54-862c-e246dca0bff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.451332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ceb968-fa54-4b54-862c-e246dca0bff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.452910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ceb968-fa54-4b54-862c-e246dca0bff3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.463212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 881/1767] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:33.467599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:33.478228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f2210-e958-4bb1-a282-7d4c284e2038 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:33.482692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.483329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.483612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.483886 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] PATH_INFO: `/v3/projects/856b819d093c4161a5b7d8dbed40022a/users/65173a8e972948b7af1e94d99563b8ce/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.499051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=856b819d093c4161a5b7d8dbed40022a, user_id=65173a8e972948b7af1e94d99563b8ce, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.501788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.572151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 887/1768] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:33 2022] PUT /identity/v3/projects/856b819d093c4161a5b7d8dbed40022a/users/65173a8e972948b7af1e94d99563b8ce/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:33.582799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.583331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.583688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.623737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] MFA Rules not processed for user `65173a8e972948b7af1e94d99563b8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:33.625348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:33.698119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 882/1769] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:33.777128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:33.784286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:33.848675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0439b14-cd97-478b-b6bf-f5c85be8de7b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:33.853135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a20d-411c-4717-8627-fc6316dd7632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:33.854944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a20d-411c-4717-8627-fc6316dd7632 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:33.854944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a20d-411c-4717-8627-fc6316dd7632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:33.854944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a20d-411c-4717-8627-fc6316dd7632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:33.863816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5a20d-411c-4717-8627-fc6316dd7632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:33.865357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5a20d-411c-4717-8627-fc6316dd7632 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:33.879127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 888/1770] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:34.434515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:34.680253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:35.141523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:35.158827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd10a1-61d8-4239-8328-78b9ff4ae772 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:35.162568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:35.163239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:35.163562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:35.163836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:35.165722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:35.248153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:35.249623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d6d15-87c5-41a1-ad91-e7b9222f92a6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:35.262415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 883/1771] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:36.704532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11c74-61cd-4c8b-afe7-aef280b238d6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:36.705394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11c74-61cd-4c8b-afe7-aef280b238d6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:36.705936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11c74-61cd-4c8b-afe7-aef280b238d6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:36.707491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 889/1772] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:44:36.728326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc382-294d-40cb-a3c8-b9150848fbb3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:36.728876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc382-294d-40cb-a3c8-b9150848fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:36.729292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc382-294d-40cb-a3c8-b9150848fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:36.753477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-088cc382-294d-40cb-a3c8-b9150848fbb3 None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:36.755314 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-088cc382-294d-40cb-a3c8-b9150848fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:36.820659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:36.838782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 884/1773] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:44:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:36.850100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9451c6-fe6f-46a0-b0e0-b2f65f54967d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:36.850408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9451c6-fe6f-46a0-b0e0-b2f65f54967d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:36.850760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9451c6-fe6f-46a0-b0e0-b2f65f54967d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:36.852245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 890/1774] 10.222.0.26 () {54 vars in 961 bytes} [Wed Nov 2 07:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:44:36.857396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:36.857716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:36.858001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:36.914123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:36.915453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:36.918948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9451c6-fe6f-46a0-b0e0-b2f65f54967d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:36.920841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6a9451c6-fe6f-46a0-b0e0-b2f65f54967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:36.931598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 885/1775] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Nov 2 07:44:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:36.941499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:36.956037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61b91-61a0-4b16-a2c0-e51b0ccc68f5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:36.974517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:36.975431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:36.975431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:36.975692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:36.986602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:36.988238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:37.008879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 886/1776] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:37.034035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9451c6-fe6f-46a0-b0e0-b2f65f54967d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:37.038693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:37.039385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:37.039691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:37.039922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] PATH_INFO: `/v3/users/33ef03ba2d8c43d6a745490b9ea2afdf` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:37.041148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ef03ba2d8c43d6a745490b9ea2afdf)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:37.043255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:37.191477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:37.275690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ef03ba2d8c43d6a745490b9ea2afdf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:37.276827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ef03ba2d8c43d6a745490b9ea2afdf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:37.291587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ef03ba2d8c43d6a745490b9ea2afdf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:37.300328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ef03ba2d8c43d6a745490b9ea2afdf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:37.301043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c10e4eb2-cf4b-430a-a2c8-8a8c559a6a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ef03ba2d8c43d6a745490b9ea2afdf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:37.363507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 891/1777] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:36 2022] DELETE /identity/v3/users/33ef03ba2d8c43d6a745490b9ea2afdf => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:37.674689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:37.700619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59adb61-f80d-4c67-a9f4-e0022a1b082f service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:37.767527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:37.768189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:37.768456 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:37.768732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] PATH_INFO: `/v3/projects/20acd5f2f33f4da8a4ef61363a283844` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:37.769893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20acd5f2f33f4da8a4ef61363a283844)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:37.771822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:37.896387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20acd5f2f33f4da8a4ef61363a283844', 'request_id': 'req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:37.903165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20acd5f2f33f4da8a4ef61363a283844', 'request_id': 'req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:38.002656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20acd5f2f33f4da8a4ef61363a283844', 'request_id': 'req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:38.015216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] The token cache is being invalidate because project 20acd5f2f33f4da8a4ef61363a283844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:38.015508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:38.016162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e75b3b1-7c16-4439-a9a5-b3cddf01c43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:38.018494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 887/1778] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:37 2022] DELETE /identity/v3/projects/20acd5f2f33f4da8a4ef61363a283844 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:38.024875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.027029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.027379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.047802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:38.049394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:38.113509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 892/1779] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:38.121808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.125268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.125268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.144092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:38.145293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:38.161186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 888/1780] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:38.166912 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.177334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eea3a-d3d5-44b7-9dff-d3d653463988 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.182611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.183436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.183719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.184017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.184667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:38.184969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.186599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.199688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 893/1781] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:38.204292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.214576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25944959-681d-45d5-bad6-c1c946ec3de3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.220006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.220618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.221149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.221866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.223474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.224434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.332155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 889/1782] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:38 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:38.332743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.351336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0bb48-fb1f-40c4-aba4-6bd3f960c9c0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.438104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.438727 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.439049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.439287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.448348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.448348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.534237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 894/1783] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:38 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:38.538466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.548488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbe8d-73bc-47dd-a05e-36549b0ba36b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.553072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.554209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.554512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.560407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.560407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.560407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.566576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 890/1784] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:38.571212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.581195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f734e3-e58b-468b-984e-3c1f9b725742 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.587239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b1c71-ea2e-4d39-9ab5-2095e7339923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.587239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1c71-ea2e-4d39-9ab5-2095e7339923 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.587239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1c71-ea2e-4d39-9ab5-2095e7339923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.587239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b1c71-ea2e-4d39-9ab5-2095e7339923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.587686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1c71-ea2e-4d39-9ab5-2095e7339923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.589259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b1c71-ea2e-4d39-9ab5-2095e7339923 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.600127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 895/1785] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:38.604399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.614539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beff57a-b944-4762-a9b3-b34a516b6b43 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.619550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.620183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.620469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.620812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] PATH_INFO: `/v3/projects/d7f2de7ef6924f53a50e8f8fa33fb6e3/users/381a9a193fb44afca97b07e550b694db/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.635516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f2de7ef6924f53a50e8f8fa33fb6e3, user_id=381a9a193fb44afca97b07e550b694db, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.638244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.713987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 891/1786] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:38 2022] PUT /identity/v3/projects/d7f2de7ef6924f53a50e8f8fa33fb6e3/users/381a9a193fb44afca97b07e550b694db/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:38.719161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.719445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.719716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.739321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:38.740509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:38.799954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 896/1787] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:38.809986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:38.812286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:38.876177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04434d1b-789f-46a2-bf81-9fcd71a2d671 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:38.881228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612a0ba-4d42-4fd1-b14b-ac1ab3fa6109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:38.881228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a0ba-4d42-4fd1-b14b-ac1ab3fa6109 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:38.881228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a0ba-4d42-4fd1-b14b-ac1ab3fa6109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:38.881228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612a0ba-4d42-4fd1-b14b-ac1ab3fa6109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:38.891088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a0ba-4d42-4fd1-b14b-ac1ab3fa6109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:38.892534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612a0ba-4d42-4fd1-b14b-ac1ab3fa6109 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:38.902682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 892/1788] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:39.084954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:39.359550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:39.844477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:39.846225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:39.858743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79de36-69f9-44de-b151-d6bd73adc103 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:39.863718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:39.864355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:39.864641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:39.864959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] PATH_INFO: `/v3/users/65173a8e972948b7af1e94d99563b8ce` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:39.866730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65173a8e972948b7af1e94d99563b8ce)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:39.868697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:40.143395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65173a8e972948b7af1e94d99563b8ce'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:40.145603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65173a8e972948b7af1e94d99563b8ce'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:40.163490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65173a8e972948b7af1e94d99563b8ce'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:40.172316 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65173a8e972948b7af1e94d99563b8ce'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:40.173060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65173a8e972948b7af1e94d99563b8ce'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:40.253105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 897/1789] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:39 2022] DELETE /identity/v3/users/65173a8e972948b7af1e94d99563b8ce => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:40.258150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:40.258632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:40.258748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:40.277711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:40.278915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:40.339072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 893/1790] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:40.349099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:40.350542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:40.434644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f092ce-93e4-4af0-92d5-3c07524e8547 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:40.438902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100278-8758-4b49-a468-0b152ceb5ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:40.439614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100278-8758-4b49-a468-0b152ceb5ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:40.439972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100278-8758-4b49-a468-0b152ceb5ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:40.440722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100278-8758-4b49-a468-0b152ceb5ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:40.451194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100278-8758-4b49-a468-0b152ceb5ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:40.452628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100278-8758-4b49-a468-0b152ceb5ad4 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:40.464129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 898/1791] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:40.871114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:41.009391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.010903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.029226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9c78a-9cff-45c0-b681-0ba98137b2e1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.035689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.036829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.037120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.037391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] PATH_INFO: `/v3/projects/856b819d093c4161a5b7d8dbed40022a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.038761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=856b819d093c4161a5b7d8dbed40022a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.040981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.165277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:41.185248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856b819d093c4161a5b7d8dbed40022a', 'request_id': 'req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.195576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856b819d093c4161a5b7d8dbed40022a', 'request_id': 'req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.262265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856b819d093c4161a5b7d8dbed40022a', 'request_id': 'req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.281665 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] The token cache is being invalidate because project 856b819d093c4161a5b7d8dbed40022a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:41.282210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.283788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.290864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 894/1792] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:41 2022] DELETE /identity/v3/projects/856b819d093c4161a5b7d8dbed40022a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:41.294548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c3e6-6dd1-489c-a68d-30e77d7cbdb4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.294835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c3e6-6dd1-489c-a68d-30e77d7cbdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.295113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c3e6-6dd1-489c-a68d-30e77d7cbdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.310569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.312199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.331353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-17b5c3e6-6dd1-489c-a68d-30e77d7cbdb4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:41.332611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-17b5c3e6-6dd1-489c-a68d-30e77d7cbdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.407220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddaa39-3cfb-4b32-b350-cd085df6f48d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.423509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.423509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.423509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.423509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] PATH_INFO: `/v3/users/b7a175d3729548978ba7af5070ef6da6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.424349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a175d3729548978ba7af5070ef6da6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.424349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.456016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 899/1793] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:41.463878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.464218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.464494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.486512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:41.491637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.525489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 900/1794] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:41.527777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.548896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb98533-fb00-4b68-9163-6a9d487e14ef None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.562383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.563262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.563711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.564134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.564874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:41.565184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.567069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.581165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 901/1795] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:41.585807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.600087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ce24c-1a4c-498e-9bc6-c4c726caf766 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.603615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.604376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.604664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.604918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.605587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.607503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.733125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 902/1796] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:41 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:41.737215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.742721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a175d3729548978ba7af5070ef6da6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.743742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a175d3729548978ba7af5070ef6da6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.765263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a175d3729548978ba7af5070ef6da6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.830516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff36ca-6a58-4738-856f-c77d3e2421fd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.837239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.837946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.838225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.838495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.839130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.841074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.883788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a175d3729548978ba7af5070ef6da6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.889190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a175d3729548978ba7af5070ef6da6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:41.903631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 895/1797] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:41 2022] DELETE /identity/v3/users/b7a175d3729548978ba7af5070ef6da6 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:41.908218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.909632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.938854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 903/1798] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:41 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:41.941044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.941266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.953394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491f5c-442c-4fbd-9634-74b900d5372b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.977398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2eca-5066-4e8f-8fc0-2511da710859 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.987919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.988572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.988850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.989120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] PATH_INFO: `/v3/users/8a379a5cb7c3402ca5a0dbc6c0d2cf67` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.990304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a379a5cb7c3402ca5a0dbc6c0d2cf67)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.993096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.039655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.040654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.040654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.040988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] PATH_INFO: `/v3/users/2429833db2a14df48e8a4486adfb456e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.042619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2429833db2a14df48e8a4486adfb456e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.046588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.268003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a379a5cb7c3402ca5a0dbc6c0d2cf67'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.268953 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a379a5cb7c3402ca5a0dbc6c0d2cf67'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.290371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a379a5cb7c3402ca5a0dbc6c0d2cf67'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.299500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2429833db2a14df48e8a4486adfb456e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.300935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2429833db2a14df48e8a4486adfb456e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.316526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2429833db2a14df48e8a4486adfb456e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.325245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2429833db2a14df48e8a4486adfb456e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.325957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2429833db2a14df48e8a4486adfb456e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.399226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a379a5cb7c3402ca5a0dbc6c0d2cf67'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.408429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9fe63a5a-5c76-4179-8770-4afc1acbbe9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a379a5cb7c3402ca5a0dbc6c0d2cf67'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:42.419889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 896/1799] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:41 2022] DELETE /identity/v3/users/8a379a5cb7c3402ca5a0dbc6c0d2cf67 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:42.419889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61096d-023e-47c6-95dd-8759c5df2002 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.419889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61096d-023e-47c6-95dd-8759c5df2002 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.419889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61096d-023e-47c6-95dd-8759c5df2002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.441041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0c61096d-023e-47c6-95dd-8759c5df2002 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:42.442339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0c61096d-023e-47c6-95dd-8759c5df2002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:42.457373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 904/1800] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:41 2022] DELETE /identity/v3/users/2429833db2a14df48e8a4486adfb456e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:42.461071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:42.462218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:42.545725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 897/1801] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:42.547470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9c57-44fe-423f-8ddb-e7607dd283ba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.547961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9c57-44fe-423f-8ddb-e7607dd283ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.548479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9c57-44fe-423f-8ddb-e7607dd283ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.586436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c23c9c57-44fe-423f-8ddb-e7607dd283ba None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:42.588271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c23c9c57-44fe-423f-8ddb-e7607dd283ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:42.601771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 898/1802] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:42.605470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83572a-8c7f-41fe-93c4-d0545e4caaa5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:42.611889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.612461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.612711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.612828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.613001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.613099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.613355 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.613671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.615644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.618917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:42.651190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 905/1803] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:42.652168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:42.655313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:42.657860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:42.660529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:42.676881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 899/1804] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:42.677802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:42.682742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:42.745859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1078a76-d9f5-4f88-b7d6-c1a955e3ceb2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:42.751215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.753796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.753796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.753796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.759100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db12a-28fa-4b0c-bc35-4e37e641cdc7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:42.763824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.764658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.765099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.765523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.766731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.769257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.778847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.780549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.788152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 906/1805] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:42.788152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:42.794497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 900/1806] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:42.797862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83bcc2-3432-4018-96fe-d790a35c2ceb service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:42.803383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:42.804377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.805648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.806190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.806680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.807996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.809941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.814103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b428aa-3b77-415e-a66f-4c8a87fd1a11 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:42.820421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef542-f72b-49bb-b1c4-c985288c5d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.821357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef542-f72b-49bb-b1c4-c985288c5d75 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.821915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef542-f72b-49bb-b1c4-c985288c5d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.822411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef542-f72b-49bb-b1c4-c985288c5d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.827854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 907/1807] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:42.830527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:42.836813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef542-f72b-49bb-b1c4-c985288c5d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.840924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:42.842114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef542-f72b-49bb-b1c4-c985288c5d75 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.842943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113928b-a74e-4741-99ee-8ee89d005da7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:42.848752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:42.849472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.849783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.850161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] PATH_INFO: `/v3/projects/61802db840994473b6472acc860b6626/users/5aee089a37fa4c7ca46ff115c1451e57/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:42.855510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 901/1808] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:42.871513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61802db840994473b6472acc860b6626, user_id=5aee089a37fa4c7ca46ff115c1451e57, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:42.874487 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:42.980531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 908/1809] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:42 2022] PUT /identity/v3/projects/61802db840994473b6472acc860b6626/users/5aee089a37fa4c7ca46ff115c1451e57/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:42.992329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:42.992617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:42.992892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:43.022606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] MFA Rules not processed for user `5aee089a37fa4c7ca46ff115c1451e57`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:43.023855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:43.132528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 902/1810] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:43.158335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:43.160394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:43.165018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:43.302829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98be2f-5ffe-4f1d-8279-9fbed84a3871 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:43.311902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:43.313684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:43.313684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:43.314086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:43.326574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:43.331692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:43.366571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 909/1811] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:43.511717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:43.511717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:43.548086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:43.550117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:43.691268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce693205-c59d-40c9-9a54-83e27362c73d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:43.702173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:43.705646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:43.705646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:43.705646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] PATH_INFO: `/v3/projects/16e03e77aee3421a993880cdbe5935d6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:43.706730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e03e77aee3421a993880cdbe5935d6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:43.712925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:43.728629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae65e8-a677-4d8b-913d-34433430d345 service glance] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:43.738540 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:43.739299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:43.739655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:43.740036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] PATH_INFO: `/v3/projects/9ff053960661433aa17b8fcfe8352c4b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:43.741613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff053960661433aa17b8fcfe8352c4b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:43.745023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:43.908237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e03e77aee3421a993880cdbe5935d6', 'request_id': 'req-26303600-1359-43c2-b018-d384adf33568'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:43.916318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e03e77aee3421a993880cdbe5935d6', 'request_id': 'req-26303600-1359-43c2-b018-d384adf33568'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:43.923701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff053960661433aa17b8fcfe8352c4b', 'request_id': 'req-c296938d-ef44-43a3-908d-f4abca9e09b6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:43.931117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff053960661433aa17b8fcfe8352c4b', 'request_id': 'req-c296938d-ef44-43a3-908d-f4abca9e09b6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.016563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e03e77aee3421a993880cdbe5935d6', 'request_id': 'req-26303600-1359-43c2-b018-d384adf33568'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.029066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] The token cache is being invalidate because project 16e03e77aee3421a993880cdbe5935d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:44.029419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.030348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.032054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 903/1812] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:43 2022] DELETE /identity/v3/projects/16e03e77aee3421a993880cdbe5935d6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:44.035938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:44.037497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.102202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff053960661433aa17b8fcfe8352c4b', 'request_id': 'req-c296938d-ef44-43a3-908d-f4abca9e09b6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.114585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] The token cache is being invalidate because project 9ff053960661433aa17b8fcfe8352c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:44.115343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.116249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.119713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 910/1813] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:43 2022] DELETE /identity/v3/projects/9ff053960661433aa17b8fcfe8352c4b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:44.120701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:44.122314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.130751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26303600-1359-43c2-b018-d384adf33568 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:44.230710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:44.231454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:44.235934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:44.235934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] PATH_INFO: `/v3/projects/9ce5922179d341dcb3375391138aaf6d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:44.235934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce5922179d341dcb3375391138aaf6d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:44.236709 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296938d-ef44-43a3-908d-f4abca9e09b6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:44.236838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:44.244018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:44.246336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:44.246654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:44.246939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:44.253317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.340154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:44.341734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88c154-1614-4647-9b03-8fe2eb37e639 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:44.353137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 911/1814] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:44.355015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:44.355517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:44.355804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:44.400256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:44.409480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.413731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce5922179d341dcb3375391138aaf6d', 'request_id': 'req-beb8850f-4888-45a4-a925-cccb105a91d6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.434574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce5922179d341dcb3375391138aaf6d', 'request_id': 'req-beb8850f-4888-45a4-a925-cccb105a91d6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.509352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce5922179d341dcb3375391138aaf6d', 'request_id': 'req-beb8850f-4888-45a4-a925-cccb105a91d6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.533008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 912/1815] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:44.534284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:44.536057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.540093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] The token cache is being invalidate because project 9ce5922179d341dcb3375391138aaf6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:44.540605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.545006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-beb8850f-4888-45a4-a925-cccb105a91d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.546529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 904/1816] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:44 2022] DELETE /identity/v3/projects/9ce5922179d341dcb3375391138aaf6d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:44.550507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:44.551215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:44.551911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:44.565129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51821a1f-3931-47e2-a9a7-e6d58ee72256 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:44.584769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:44.585443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:44.585750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:44.586071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] PATH_INFO: `/v3/users/61bb83f46fd743b39e466eccc5a1ce4c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:44.587319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bb83f46fd743b39e466eccc5a1ce4c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:44.589334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:44.606209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:44.608904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.635332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 905/1817] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:44.636279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:44.638984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:44.655446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada668e5-f1c9-469c-982a-43d6a1cc8ca5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:44.661289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:44.662232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:44.662521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:44.662820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] PATH_INFO: `/v3/users/9ca0d1f3bd94473da3a0aab2888e919e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:44.664553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca0d1f3bd94473da3a0aab2888e919e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:44.666808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:44.859633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bb83f46fd743b39e466eccc5a1ce4c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.861224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bb83f46fd743b39e466eccc5a1ce4c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.882092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca0d1f3bd94473da3a0aab2888e919e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.883071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca0d1f3bd94473da3a0aab2888e919e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.884739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bb83f46fd743b39e466eccc5a1ce4c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.893986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bb83f46fd743b39e466eccc5a1ce4c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.894789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bb83f46fd743b39e466eccc5a1ce4c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.902484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca0d1f3bd94473da3a0aab2888e919e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:44.985122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 913/1818] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:44 2022] DELETE /identity/v3/users/61bb83f46fd743b39e466eccc5a1ce4c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:44.989257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:44.991541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:45.037014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca0d1f3bd94473da3a0aab2888e919e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:45.052336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca0d1f3bd94473da3a0aab2888e919e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:45.061927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 906/1819] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:44 2022] DELETE /identity/v3/users/9ca0d1f3bd94473da3a0aab2888e919e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:45.065238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:45.081675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebcb6b-f622-41f2-850d-fca8c1832b76 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.176553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.177284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.177284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.177778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.178608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:45.178921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:45.180591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:45.197592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 914/1820] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:45.200862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:45.202971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:45.218625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855cc9-3de8-42d3-964b-dc376d9047a0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.225748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.225906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.226104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.226376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.227104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:45.228990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:45.358692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 907/1821] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:45 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:45.363182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:45.378578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d52e-d6bd-4319-9f03-297d344e184a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.473135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.475397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.475789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.476949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.477586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:45.479738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:45.574522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 915/1822] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:45 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:45.578919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:45.590827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:45.607128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392c02-2e55-49a5-9381-1f69721de691 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.607128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.607128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.607128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.609784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.609784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:45.610311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:45.658596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 908/1823] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:45.662856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:45.683651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e991eec-d1f3-42ca-97d9-ab6118f8882b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.705950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.706832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.707209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.707669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.708516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:45.712035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:45.731983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 916/1824] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:45.737020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:45.753877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8adbe6-724a-4061-9975-4779e4ad4d3b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.763221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebf84d-b4be-4a93-b8a9-8651f6fce761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.764051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebf84d-b4be-4a93-b8a9-8651f6fce761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.764357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebf84d-b4be-4a93-b8a9-8651f6fce761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.764657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebf84d-b4be-4a93-b8a9-8651f6fce761 admin admin] PATH_INFO: `/v3/projects/759de22996724ce8af78d861dd186c92/users/92222f9af7d54f978e7529d030228db1/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.796344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebf84d-b4be-4a93-b8a9-8651f6fce761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759de22996724ce8af78d861dd186c92, user_id=92222f9af7d54f978e7529d030228db1, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:45.802517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebf84d-b4be-4a93-b8a9-8651f6fce761 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:45.827388 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:45.830319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:45.864989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53285-81fb-4797-9678-0b334baa1d01 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:45.885206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 909/1825] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:45 2022] PUT /identity/v3/projects/759de22996724ce8af78d861dd186c92/users/92222f9af7d54f978e7529d030228db1/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:45.889064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.889605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.890046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:45.954403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] MFA Rules not processed for user `92222f9af7d54f978e7529d030228db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:45.956193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:45.996599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:45.997759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:45.998374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:45.998840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] PATH_INFO: `/v3/projects/e3b651da88b343ac8176c98dca54665f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:46.000251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b651da88b343ac8176c98dca54665f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:46.003173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:46.074429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 910/1826] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:46.088281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:46.091708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:46.162064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b651da88b343ac8176c98dca54665f', 'request_id': 'req-ede264c8-266a-4389-a1bf-daf2f8e7206c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.178743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b651da88b343ac8176c98dca54665f', 'request_id': 'req-ede264c8-266a-4389-a1bf-daf2f8e7206c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.254022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc58ed8-b360-4255-a348-cb9bdcf8178c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:46.261812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b651da88b343ac8176c98dca54665f', 'request_id': 'req-ede264c8-266a-4389-a1bf-daf2f8e7206c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.281326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] The token cache is being invalidate because project e3b651da88b343ac8176c98dca54665f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:46.281718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.282413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.287643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 917/1827] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:45 2022] DELETE /identity/v3/projects/e3b651da88b343ac8176c98dca54665f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:46.303761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:46.303761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:46.370736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:46.371589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:46.372056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:46.372492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:46.388207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:46.487668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede264c8-266a-4389-a1bf-daf2f8e7206c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:46.494825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:46.495748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:46.496229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:46.496713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] PATH_INFO: `/v3/users/ad873f4316bd4dbbaf8f03f3b2f56061` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:46.498143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad873f4316bd4dbbaf8f03f3b2f56061)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:46.508978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:46.546357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:46.547701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:46.558441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 911/1828] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:46.561458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:46.563045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:46.598588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3aecd-baa5-4c1a-9a4b-515272d7761c service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:46.604709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:46.605458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:46.605936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:46.606381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] PATH_INFO: `/v3/projects/016cf52d29ec4046a6d769896779a3c0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:46.611023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016cf52d29ec4046a6d769896779a3c0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:46.613769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:46.628838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:46.731671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad873f4316bd4dbbaf8f03f3b2f56061'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.732425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad873f4316bd4dbbaf8f03f3b2f56061'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.758683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad873f4316bd4dbbaf8f03f3b2f56061'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.767707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad873f4316bd4dbbaf8f03f3b2f56061'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.770554 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e56c43b-63e9-40e9-bdd7-082ea6c8cef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad873f4316bd4dbbaf8f03f3b2f56061'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.784691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016cf52d29ec4046a6d769896779a3c0', 'request_id': 'req-e0419174-89fc-4cd4-adc0-df7bd0087fe6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.795443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016cf52d29ec4046a6d769896779a3c0', 'request_id': 'req-e0419174-89fc-4cd4-adc0-df7bd0087fe6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.853347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 918/1829] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:46 2022] DELETE /identity/v3/users/ad873f4316bd4dbbaf8f03f3b2f56061 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:46.856710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:46.856710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:46.857198 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:46.898647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] MFA Rules not processed for user `381a9a193fb44afca97b07e550b694db`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:46.900507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:46.928403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016cf52d29ec4046a6d769896779a3c0', 'request_id': 'req-e0419174-89fc-4cd4-adc0-df7bd0087fe6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.946429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] The token cache is being invalidate because project 016cf52d29ec4046a6d769896779a3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:46.946796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.947576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e0419174-89fc-4cd4-adc0-df7bd0087fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:46.954857 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 912/1830] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:46 2022] DELETE /identity/v3/projects/016cf52d29ec4046a6d769896779a3c0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:46.960219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d3c7e-d89c-4e3f-b717-20c89f89ace2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:46.960502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d3c7e-d89c-4e3f-b717-20c89f89ace2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:46.972189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d3c7e-d89c-4e3f-b717-20c89f89ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.003964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-645d3c7e-d89c-4e3f-b717-20c89f89ace2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:47.005265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-645d3c7e-d89c-4e3f-b717-20c89f89ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:47.019126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 919/1831] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:47.033818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.035235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:47.087165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 913/1832] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:47.095144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.096180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.096180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.126057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:47.127497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:47.136402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 914/1833] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:47.144152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.154922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b7166-43a9-4112-834d-6791667015ab None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.157826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed499cd4-080d-4147-b9cf-500d12f0521a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.160874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.161659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.168045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.169139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.170787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.171648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.177958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.177958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.177958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:47.177958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.180603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.187290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.194067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.202642 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 915/1834] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:47.206535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.213334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 920/1835] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:47.221782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b768f4-18bb-41e9-8fb7-d253c5f9b44d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.227111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.229204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.229683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.235272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.235272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.235272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.373129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 916/1836] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:47 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:47.377526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.388945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186af34-212f-429d-a06a-b46c8234ae25 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.406412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.410898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:47.472922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.473884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.474184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.474409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.475402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.477330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.512191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc18d-9a2c-4488-bce5-5563d31d7772 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.517176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.517998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.518369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.518705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] PATH_INFO: `/v3/projects/1b97cbe4ea5e4c23b90237cea87af082` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.519959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b97cbe4ea5e4c23b90237cea87af082)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.522721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.629314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 921/1837] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:47 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:47.634093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.644239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac888a-f3e0-4a1f-98e4-5abc69c0c4f6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.649072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.649700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.649982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.650256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.650895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.652471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.663964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 922/1838] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:47.668078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.682346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa380d9-9f29-4a5f-bc6b-5f8b06563db5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.693431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b97cbe4ea5e4c23b90237cea87af082', 'request_id': 'req-146743a4-3130-450f-baa0-d8706fba4fe3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:47.706543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b97cbe4ea5e4c23b90237cea87af082', 'request_id': 'req-146743a4-3130-450f-baa0-d8706fba4fe3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:47.802702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.803326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.803608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.803887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.804529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.806190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.821686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 923/1839] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:47.827263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:47.841793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27193ea0-a311-4709-83a3-601a96dd9a99 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:47.848063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159d6a-cdad-4d91-8470-363c82aa8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:47.848828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159d6a-cdad-4d91-8470-363c82aa8984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.849189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159d6a-cdad-4d91-8470-363c82aa8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.850129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159d6a-cdad-4d91-8470-363c82aa8984 admin admin] PATH_INFO: `/v3/projects/b95e0f08e74a4fa39f04dd6197e7b539/users/d1b78acb6cb34120828f832c451221ca/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.866682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e159d6a-cdad-4d91-8470-363c82aa8984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95e0f08e74a4fa39f04dd6197e7b539, user_id=d1b78acb6cb34120828f832c451221ca, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:47.870108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e159d6a-cdad-4d91-8470-363c82aa8984 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:47.932046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b97cbe4ea5e4c23b90237cea87af082', 'request_id': 'req-146743a4-3130-450f-baa0-d8706fba4fe3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:47.946790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] The token cache is being invalidate because project 1b97cbe4ea5e4c23b90237cea87af082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:47.947113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:47.947769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-146743a4-3130-450f-baa0-d8706fba4fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:47.951694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 917/1840] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:47 2022] DELETE /identity/v3/projects/1b97cbe4ea5e4c23b90237cea87af082 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:47.952378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:47.956605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b141-d0a9-4306-b078-077e6050e4da None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.956889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b141-d0a9-4306-b078-077e6050e4da None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.957414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b141-d0a9-4306-b078-077e6050e4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.960332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 924/1841] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:47 2022] PUT /identity/v3/projects/b95e0f08e74a4fa39f04dd6197e7b539/users/d1b78acb6cb34120828f832c451221ca/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:47.971392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:47.971679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:47.971979 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:47.986958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1644b141-d0a9-4306-b078-077e6050e4da None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:47.989002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1644b141-d0a9-4306-b078-077e6050e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:48.014322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] MFA Rules not processed for user `d1b78acb6cb34120828f832c451221ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:48.017468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:48.067016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 918/1842] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:48.079815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.079815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.079815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.097300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 925/1843] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:48.098032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.100158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:48.100451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:48.101700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:48.110038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 919/1844] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:48.115251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c7001-ac2e-41ab-933c-18b42fa53049 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.121385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.122192 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.122527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.122807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.123446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.123553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.125457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.136285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86dc7b-f3f7-45b7-9ade-8426dc165499 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.144463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.145186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.145527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.146174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.147381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:48.147681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.155634 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.178894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 920/1845] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:48.183275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.206030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d477b-b8c0-4dac-bf78-550957669e69 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.212273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 926/1846] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:48 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:48.213269 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.335300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715349a2-27d2-4d5a-8ff7-c7d5b5abe7c8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.353045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.364079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.364079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.364367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.365055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.373717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.405369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.406114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.406415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.406688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.407517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.409866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.518768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 927/1847] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:48 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:48.527627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.546390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 921/1848] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:48 2022] POST /identity/v3/projects => generated 373 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:48.550892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.553578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80613a94-4085-410a-8486-fd8b2fd30534 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.725799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.728116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.728631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.729115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.730036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.733976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3204ba5-96b0-4c61-bdbc-c50d838a210e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.742521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.750045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.750959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.751404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.751838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.752659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.754925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.767092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 928/1849] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:48.772157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.800992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3207ece-a2e3-40f0-9ba5-ff4c74b7ffd8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:48.804572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:48.805126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:48.805400 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:48.805706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] PATH_INFO: `/v3/projects/fe31830c06c844c7a19f4d9e639aa433/users/f894b2b99aa04bb7a30491654d4a80bc/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:48.829801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe31830c06c844c7a19f4d9e639aa433, user_id=f894b2b99aa04bb7a30491654d4a80bc, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:48.832333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:48.886033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 922/1850] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:48 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:48.889218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.907136 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:48.913382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 929/1851] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:48 2022] PUT /identity/v3/projects/fe31830c06c844c7a19f4d9e639aa433/users/f894b2b99aa04bb7a30491654d4a80bc/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:48.918518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:48.924669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e4ce2-6fac-46ea-af42-99c58c3390be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.031330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db0aa9-5983-42b3-b04e-d0573a2e6c7d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.046417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.048674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.048869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.050636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.054054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.058010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.078120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 930/1852] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:49.079738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:49.096765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a50701-76c3-4f7e-a020-d27b39e3c04c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.099012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.099862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.100896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.101247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.102003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.104824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.105915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691020-8765-4c3f-81af-d842bef92a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.107862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691020-8765-4c3f-81af-d842bef92a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.108158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691020-8765-4c3f-81af-d842bef92a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.108441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691020-8765-4c3f-81af-d842bef92a07 admin admin] PATH_INFO: `/v3/projects/fe31830c06c844c7a19f4d9e639aa433/users/f894b2b99aa04bb7a30491654d4a80bc/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.113968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691020-8765-4c3f-81af-d842bef92a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe31830c06c844c7a19f4d9e639aa433, user_id=f894b2b99aa04bb7a30491654d4a80bc, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.116851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691020-8765-4c3f-81af-d842bef92a07 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.123932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 923/1853] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:49.127970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:49.135061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 931/1854] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:49 2022] PUT /identity/v3/projects/fe31830c06c844c7a19f4d9e639aa433/users/f894b2b99aa04bb7a30491654d4a80bc/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:49.141037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6540c0-dd8e-44af-a3c8-1b267025be70 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.148605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.148890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.149171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.191978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] MFA Rules not processed for user `f894b2b99aa04bb7a30491654d4a80bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:49.194049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:49.254507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.264503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.264805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.265102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.265873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.267419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.281226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 924/1855] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:49.287772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:49.305952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b8a4-eb97-4fd4-abff-01744ad1ef5b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.311499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876a93-27fc-4442-bed8-782fbb418de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.312146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876a93-27fc-4442-bed8-782fbb418de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.315224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876a93-27fc-4442-bed8-782fbb418de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.315376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 932/1856] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:49.317794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876a93-27fc-4442-bed8-782fbb418de2 admin admin] PATH_INFO: `/v3/projects/d93d4546741c4135b52082f8d0fdfc4c/users/3d7238669a7c4367872b92e5084d5422/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.325256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:49.327505 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:49.337166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876a93-27fc-4442-bed8-782fbb418de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93d4546741c4135b52082f8d0fdfc4c, user_id=3d7238669a7c4367872b92e5084d5422, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.342158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39876a93-27fc-4442-bed8-782fbb418de2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.423865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032287f-4fb4-411a-ad36-ceb013e9ff54 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.428092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.428761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.429041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.429310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.440832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 925/1857] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:49 2022] PUT /identity/v3/projects/d93d4546741c4135b52082f8d0fdfc4c/users/3d7238669a7c4367872b92e5084d5422/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:49.444713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fcce5-8de3-465e-bf95-5e098a8b59cb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.445006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fcce5-8de3-465e-bf95-5e098a8b59cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.445641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fcce5-8de3-465e-bf95-5e098a8b59cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.453953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.455571 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.470637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 933/1858] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:49.471871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-958fcce5-8de3-465e-bf95-5e098a8b59cb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:49.474330 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-958fcce5-8de3-465e-bf95-5e098a8b59cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:49.555863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 926/1859] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:49.570659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:49.572235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:49.648284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6fcd-e008-46e1-9bb7-f3ca5700af22 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:49.714935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:49.715635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:49.715851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:49.716106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:49.726874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:49.728387 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:49.746292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 934/1860] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:50.163004 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:50.763724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ca38-07ef-4bcd-883f-721e72abca8e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:50.764679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ca38-07ef-4bcd-883f-721e72abca8e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:50.765156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ca38-07ef-4bcd-883f-721e72abca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:50.822141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cd40ca38-07ef-4bcd-883f-721e72abca8e None None] MFA Rules not processed for user `381a9a193fb44afca97b07e550b694db`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:50.825692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cd40ca38-07ef-4bcd-883f-721e72abca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:50.963304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:50.973531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 927/1861] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:50.980751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7bee8-6176-4f3d-8dc5-2e232bd58f8f service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:50.988976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:50.989963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:50.990337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:50.990719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] PATH_INFO: `/v3/users/d1b78acb6cb34120828f832c451221ca` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:50.991954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b78acb6cb34120828f832c451221ca)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:51.003403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:51.263035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b78acb6cb34120828f832c451221ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:51.263713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b78acb6cb34120828f832c451221ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:51.267698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:51.279746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b78acb6cb34120828f832c451221ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:51.289986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b78acb6cb34120828f832c451221ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:51.292842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b78acb6cb34120828f832c451221ca'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:51.370082 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 935/1862] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:50 2022] DELETE /identity/v3/users/d1b78acb6cb34120828f832c451221ca => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:51.372124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb634f6-0c1c-4c25-8f10-0f847305ad0a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:51.372409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb634f6-0c1c-4c25-8f10-0f847305ad0a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:51.372770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb634f6-0c1c-4c25-8f10-0f847305ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:51.404941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1eb634f6-0c1c-4c25-8f10-0f847305ad0a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:51.406278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1eb634f6-0c1c-4c25-8f10-0f847305ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:51.478653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 928/1863] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:51.490447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:51.491936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:51.562898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfbddb-c4dd-4e97-84c6-260e2b7d5254 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:51.566893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:51.567503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:51.567780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:51.568824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:51.578389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:51.580043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:51.590386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 936/1864] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:51.593647 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:51.648750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:51.649033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:51.649312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:51.680454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] MFA Rules not processed for user `3d7238669a7c4367872b92e5084d5422`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:51.685241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:51.779414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 929/1865] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:51.790324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:51.791739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:51.851224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d279b-ec6f-415a-95b4-5f6fc84c2498 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:51.855368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:51.855977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:51.856255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:51.856524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:51.868047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:51.870116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:51.888294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 937/1866] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:52.148436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:52.150235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:52.174295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc13a7c-0f0b-4142-895b-146663783ba0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:52.180372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:52.181015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:52.181294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:52.181624 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] PATH_INFO: `/v3/projects/b95e0f08e74a4fa39f04dd6197e7b539` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:52.185576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95e0f08e74a4fa39f04dd6197e7b539)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:52.185576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:52.291148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95e0f08e74a4fa39f04dd6197e7b539', 'request_id': 'req-8e269d30-a6f3-4a66-b174-9238ee9712e3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.303030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95e0f08e74a4fa39f04dd6197e7b539', 'request_id': 'req-8e269d30-a6f3-4a66-b174-9238ee9712e3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.406786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95e0f08e74a4fa39f04dd6197e7b539', 'request_id': 'req-8e269d30-a6f3-4a66-b174-9238ee9712e3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.420099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] The token cache is being invalidate because project b95e0f08e74a4fa39f04dd6197e7b539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:52.420380 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.421022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.422736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 930/1867] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:52 2022] DELETE /identity/v3/projects/b95e0f08e74a4fa39f04dd6197e7b539 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:52.426720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:52.438701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edc247-8af1-45b4-b370-b2c97b4f42f7 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:52.533361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:52.534343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:52.534632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:52.534907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] PATH_INFO: `/v3/users/f894b2b99aa04bb7a30491654d4a80bc` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:52.536378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f894b2b99aa04bb7a30491654d4a80bc)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:52.540235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:52.712870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:52.866923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f894b2b99aa04bb7a30491654d4a80bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.868020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f894b2b99aa04bb7a30491654d4a80bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.889793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f894b2b99aa04bb7a30491654d4a80bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.898572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f894b2b99aa04bb7a30491654d4a80bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.899304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-98c6baa6-93cc-41a8-a373-078824eb31d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f894b2b99aa04bb7a30491654d4a80bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:52.918497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:52.974333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 938/1868] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:52 2022] DELETE /identity/v3/users/f894b2b99aa04bb7a30491654d4a80bc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:53.399577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:53.401160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:53.415075 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269d30-a6f3-4a66-b174-9238ee9712e3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:53.505081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:53.505081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:53.505081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:53.505081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] PATH_INFO: `/v3/projects/fe31830c06c844c7a19f4d9e639aa433` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:53.505443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe31830c06c844c7a19f4d9e639aa433)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:53.507484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:53.516084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:53.656841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe31830c06c844c7a19f4d9e639aa433', 'request_id': 'req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:53.663796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe31830c06c844c7a19f4d9e639aa433', 'request_id': 'req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:53.758506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe31830c06c844c7a19f4d9e639aa433', 'request_id': 'req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:53.771378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] The token cache is being invalidate because project fe31830c06c844c7a19f4d9e639aa433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:53.771687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:53.772512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-74a48e13-8acb-4a90-a5b1-4ce16461e5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:53.774027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 931/1869] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:53 2022] DELETE /identity/v3/projects/fe31830c06c844c7a19f4d9e639aa433 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:53.779599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:53.789919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:53.789919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:53.801477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:53.802787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:53.861501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 939/1870] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:53.869391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:53.869719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:53.870005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:53.892902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:53.894155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:53.902749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 932/1871] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:53.907049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:53.917194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97526038-77d1-4ddf-b5b1-893753a7dd10 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:53.921737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:53.922323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:53.922599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:53.922866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:53.923500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:44:53.923800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:53.925369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:53.936604 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 940/1872] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:44:53.940906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:53.950237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6d6e1-7bca-4bfa-80fa-b315197fc63e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:53.954931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:53.955523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:53.955801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:53.956073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:53.956702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:53.959111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.093161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 933/1873] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:53 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:54.097760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.108334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b5514-1c50-4efa-b288-8ea83691b086 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.166671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.167186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.167461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.167730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.168396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.170321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.252971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 941/1874] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:54 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:54.257632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.268413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da338-e2ea-4976-902c-903cbcd9c0d6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.274027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.274619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.274891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.275160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.275797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.277374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.288059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 934/1875] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:44:54.292079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.302545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5409ca1-a13f-4d67-a33e-ec3a3018cd1b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.307467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ff6ee-2cec-48d8-9ce3-27791c19a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.308138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff6ee-2cec-48d8-9ce3-27791c19a478 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.308427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff6ee-2cec-48d8-9ce3-27791c19a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.308698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff6ee-2cec-48d8-9ce3-27791c19a478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.309429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff6ee-2cec-48d8-9ce3-27791c19a478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.311000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ff6ee-2cec-48d8-9ce3-27791c19a478 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.322431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 942/1876] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:54.326730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.337172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee88e3-c5d0-436e-873a-83d612003dd2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.341744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.342409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.342691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.342967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] PATH_INFO: `/v3/projects/9f994da323194c7ba4e591da484fdb26/users/9fd41ee9775b49f3a6ebc225768921a6/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.357571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f994da323194c7ba4e591da484fdb26, user_id=9fd41ee9775b49f3a6ebc225768921a6, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.360247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.378569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:54.424245 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 935/1877] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:54 2022] PUT /identity/v3/projects/9f994da323194c7ba4e591da484fdb26/users/9fd41ee9775b49f3a6ebc225768921a6/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:54.435522 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.435800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.436092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.464481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] MFA Rules not processed for user `9fd41ee9775b49f3a6ebc225768921a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:54.465712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:54.530182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 943/1878] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:54.536414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.619711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e8f45-595f-464d-aa61-563840520d8d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.624701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900ffac-6575-4c8e-8cec-c9b759a2d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.629843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900ffac-6575-4c8e-8cec-c9b759a2d4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.634287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900ffac-6575-4c8e-8cec-c9b759a2d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.634287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900ffac-6575-4c8e-8cec-c9b759a2d4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.634287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900ffac-6575-4c8e-8cec-c9b759a2d4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.634287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900ffac-6575-4c8e-8cec-c9b759a2d4a2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.728792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 936/1879] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:44:54 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:44:54.732940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.744385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7d15-c93e-4107-ac60-22600194777d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.812016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.812648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.812888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.813160 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.813928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.815927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.817026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.817317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.817617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.846186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] MFA Rules not processed for user `3d7238669a7c4367872b92e5084d5422`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:54.847375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:54.903586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 937/1880] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:44:54.922760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 944/1881] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:44:54 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:44:54.925465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.937189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc333-aff4-40fa-9b98-c725ab7be613 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.941686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.942290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.942569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.942843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.943487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.945063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:54.955748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 938/1882] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:54.959676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:54.970059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acf139-c6db-41ef-a725-8e9e2d430431 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:54.975360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:54.976002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:54.976284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:54.976563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] PATH_INFO: `/v3/projects/5a299685a69f40609eb2f43838f907bd/users/b64073a0144e4f4e9cfe1c0bdd429ece/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:54.991218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a299685a69f40609eb2f43838f907bd, user_id=b64073a0144e4f4e9cfe1c0bdd429ece, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:54.993987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:55.007445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:55.081213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 945/1883] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:54 2022] PUT /identity/v3/projects/5a299685a69f40609eb2f43838f907bd/users/b64073a0144e4f4e9cfe1c0bdd429ece/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:55.085962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:55.096084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a434fe-4ffb-4e8e-9b90-50bbb4eb86e9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:55.153127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5297-2495-44d7-99be-5ea8812444a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:55.153868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5297-2495-44d7-99be-5ea8812444a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:55.154154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5297-2495-44d7-99be-5ea8812444a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:55.154427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5297-2495-44d7-99be-5ea8812444a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:55.155059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec5297-2495-44d7-99be-5ea8812444a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:55.156644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec5297-2495-44d7-99be-5ea8812444a3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:55.166149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 939/1884] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:44:55.170898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:55.182158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013b9a-4d6f-4a45-b79a-0c32bab15236 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:55.186998 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:55.187708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:55.187941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:55.188237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] PATH_INFO: `/v3/projects/5a299685a69f40609eb2f43838f907bd/users/b64073a0144e4f4e9cfe1c0bdd429ece/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:55.190186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a299685a69f40609eb2f43838f907bd, user_id=b64073a0144e4f4e9cfe1c0bdd429ece, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:55.194101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:55.203626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 946/1885] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:44:55 2022] PUT /identity/v3/projects/5a299685a69f40609eb2f43838f907bd/users/b64073a0144e4f4e9cfe1c0bdd429ece/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:44:55.214569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:55.220112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:55.220112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:55.241842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:55.244481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] MFA Rules not processed for user `b64073a0144e4f4e9cfe1c0bdd429ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:55.246131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:55.315004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 940/1886] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:44:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:55.326433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:55.328245 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:55.389629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e3d6-a885-4b70-adf9-98c4c64c4e49 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:55.393214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:55.393877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:55.394159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:55.394429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:55.450612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:55.451997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:55.460975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 947/1887] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:55.724841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:56.401106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:56.532449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:56.900976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:57.095606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:57.318139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:57.623982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:57.692304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:57.895394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:57.952221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.118315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.223947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.299053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.326708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.712341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:58.805144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.221289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.260970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.300622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.626795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.721522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=4,keystone:DELETE=13,keystone:SELECT=83 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.861760 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.871947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6040-2d4f-4123-babc-aef4fdf7a6e1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.875643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.876315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.876662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.877068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.889040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.890499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.900403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 941/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:59.970552 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:00.037940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:00.237990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:00.352055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:00.829591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:00.883615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:01.309025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:01.340698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:01.595926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:01.826762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:02.186927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:02.417639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:02.869682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:02.932234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:03.169043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:03.629411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:03.980506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:13.346447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=55 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:14.113592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=45 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:19.846335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:19.847798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:19.917250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd77f6-860e-4652-8d75-a1d06a3a76a7 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:19.921835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:19.922467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:19.922741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:19.923008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] PATH_INFO: `/v3/users/4d79dd33e88e48199c45b60bd5327759` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:19.924115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d79dd33e88e48199c45b60bd5327759)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:19.926144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:20.122702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d79dd33e88e48199c45b60bd5327759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.123358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d79dd33e88e48199c45b60bd5327759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.155756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d79dd33e88e48199c45b60bd5327759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.169493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d79dd33e88e48199c45b60bd5327759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.170455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d79dd33e88e48199c45b60bd5327759'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.243465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 948/1889] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:19 2022] DELETE /identity/v3/users/4d79dd33e88e48199c45b60bd5327759 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:20.604449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:20.625715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6598fd-b1b2-42e9-bdb7-612d2be8cb31 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:20.693239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:20.693903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:20.694186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:20.694453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] PATH_INFO: `/v3/projects/924ad2f1f1b24f95a2b1d96fc9a4deb9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:20.695603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=924ad2f1f1b24f95a2b1d96fc9a4deb9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:20.697572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:20.858812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924ad2f1f1b24f95a2b1d96fc9a4deb9', 'request_id': 'req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.866183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924ad2f1f1b24f95a2b1d96fc9a4deb9', 'request_id': 'req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.945682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924ad2f1f1b24f95a2b1d96fc9a4deb9', 'request_id': 'req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.969716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] The token cache is being invalidate because project 924ad2f1f1b24f95a2b1d96fc9a4deb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:20.972410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.974345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:20.982118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 942/1890] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:20 2022] DELETE /identity/v3/projects/924ad2f1f1b24f95a2b1d96fc9a4deb9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:20.983085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:20.984833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:21.003656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e07b29-4b1f-4122-a33d-9bb6eb4cf86c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:21.108502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:21.110080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:21.110419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:21.112377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] PATH_INFO: `/v3/users/a6a1bdabcdda499390a75fe743917fb9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:21.113926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a1bdabcdda499390a75fe743917fb9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:21.116087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:21.150380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:21.356882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a1bdabcdda499390a75fe743917fb9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:21.357746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a1bdabcdda499390a75fe743917fb9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:21.374629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a1bdabcdda499390a75fe743917fb9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:21.382746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a1bdabcdda499390a75fe743917fb9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:21.384397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b688804-d3e5-48a8-a109-e8f282732307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a1bdabcdda499390a75fe743917fb9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:21.452899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 949/1891] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:20 2022] DELETE /identity/v3/users/a6a1bdabcdda499390a75fe743917fb9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:21.892067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:21.893809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:21.907164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49f3f1-d140-4e45-98a8-bdbf010a15ec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:21.971193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:21.971859 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:21.972149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:21.972424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] PATH_INFO: `/v3/projects/43e83bd3e25f41de83a5516ebbf59735` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:21.973706 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e83bd3e25f41de83a5516ebbf59735)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:21.975873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:22.105239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:22.116752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e83bd3e25f41de83a5516ebbf59735', 'request_id': 'req-49c9a478-1c76-4269-b5f1-ab57c6118da4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:22.123507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e83bd3e25f41de83a5516ebbf59735', 'request_id': 'req-49c9a478-1c76-4269-b5f1-ab57c6118da4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:22.201467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e83bd3e25f41de83a5516ebbf59735', 'request_id': 'req-49c9a478-1c76-4269-b5f1-ab57c6118da4'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:22.213644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] The token cache is being invalidate because project 43e83bd3e25f41de83a5516ebbf59735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:22.216810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:22.216810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-49c9a478-1c76-4269-b5f1-ab57c6118da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:22.216810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 943/1892] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:21 2022] DELETE /identity/v3/projects/43e83bd3e25f41de83a5516ebbf59735 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:22.222354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1626-4268-412c-af73-808d7a8492db None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.222803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1626-4268-412c-af73-808d7a8492db None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.222909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1626-4268-412c-af73-808d7a8492db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.247654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-606b1626-4268-412c-af73-808d7a8492db None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:22.248929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-606b1626-4268-412c-af73-808d7a8492db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:22.310212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 950/1893] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:22.318528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.319036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.319471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.350904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:22.352954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:22.361737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 944/1894] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:22.365857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1626-4268-412c-af73-808d7a8492db None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:22.376879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1626-4268-412c-af73-808d7a8492db None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:22.381625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:22.382222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.382498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.382765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.383405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:22.383702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:22.385770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:22.397713 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 951/1895] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:45:22.402657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:22.411982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5150a-764c-4759-9653-b69baf696b20 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:22.419179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:22.419179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.419179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.419179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.419540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:22.420882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:22.551882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 945/1896] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:22 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:22.555969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:22.565849 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97860d06-fb4f-408c-b578-c932ff2b2f0e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:22.626057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:22.626576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.626856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.627128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.627762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:22.629815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:22.784472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 952/1897] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:22 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:22.788245 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:22.812776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fd5da-885a-47d0-83ac-251d832bc5b9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:22.825891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:22.829720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.830052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.830496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.831218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:22.833072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:22.849530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 946/1898] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:22.853947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:22.864099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373fb5d-5be1-4b60-a697-7dac66c2b1fa admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:22.872008 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb19f34-4120-4617-bcee-0a14fd680e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:22.872877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19f34-4120-4617-bcee-0a14fd680e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.873018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19f34-4120-4617-bcee-0a14fd680e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.873593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19f34-4120-4617-bcee-0a14fd680e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.873984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb19f34-4120-4617-bcee-0a14fd680e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:22.876722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb19f34-4120-4617-bcee-0a14fd680e76 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:22.892203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 953/1899] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:22.896767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:22.910348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5036e-5e01-44d3-8ba9-78fa08e90d45 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:22.916145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:22.917300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:22.917852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:22.918322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] PATH_INFO: `/v3/projects/157a5875c96e428db29fa60f9b7f8851/users/d2822a4219d54633a840a749f9e2b104/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:22.942627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=157a5875c96e428db29fa60f9b7f8851, user_id=d2822a4219d54633a840a749f9e2b104, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:22.947770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:23.042939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 947/1900] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:22 2022] PUT /identity/v3/projects/157a5875c96e428db29fa60f9b7f8851/users/d2822a4219d54633a840a749f9e2b104/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:23.053218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:23.053610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:23.053978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:23.064167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:23.085399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] MFA Rules not processed for user `d2822a4219d54633a840a749f9e2b104`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:23.086812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:23.154057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 954/1901] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:23.165713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:23.174170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:23.246275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779cf3b-d3a2-4d2f-8112-0ac17c419b4f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:23.250001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4be0-65b9-4c2d-93e9-8b66473bef85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:23.250620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4be0-65b9-4c2d-93e9-8b66473bef85 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:23.250949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4be0-65b9-4c2d-93e9-8b66473bef85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:23.251170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4be0-65b9-4c2d-93e9-8b66473bef85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:23.260116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d4be0-65b9-4c2d-93e9-8b66473bef85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:23.261730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d4be0-65b9-4c2d-93e9-8b66473bef85 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:23.272184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 948/1902] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:24.266406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:24.268890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:24.344452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fda18-29f0-4e45-986f-c42ac903ae60 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:24.349182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:24.349951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:24.350324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:24.350700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] PATH_INFO: `/v3/users/9fd41ee9775b49f3a6ebc225768921a6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:24.352073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd41ee9775b49f3a6ebc225768921a6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:24.354605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:24.575863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd41ee9775b49f3a6ebc225768921a6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:24.577530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd41ee9775b49f3a6ebc225768921a6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:24.608282 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd41ee9775b49f3a6ebc225768921a6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:24.619721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd41ee9775b49f3a6ebc225768921a6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:24.620961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd41ee9775b49f3a6ebc225768921a6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:24.811026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:24.812757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:24.813188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:24.816505 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 955/1903] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:24 2022] DELETE /identity/v3/users/9fd41ee9775b49f3a6ebc225768921a6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:24.836318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:24.838019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:24.912699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:24.925707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 949/1904] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:24.935990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:24.937480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:24.953343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:25.002326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fc3ab-87b4-46f7-8eda-15791d48bb7a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:25.006457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:25.007065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:25.007333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:25.007608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:25.017578 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:25.018999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:25.033027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 956/1905] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:25.564167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:25.567088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:25.583542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d744f9-b968-41e2-924a-40bfb60d949c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:25.591301 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:25.592175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:25.592610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:25.593312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] PATH_INFO: `/v3/projects/9f994da323194c7ba4e591da484fdb26` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:25.594664 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f994da323194c7ba4e591da484fdb26)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:25.596831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:25.756127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f994da323194c7ba4e591da484fdb26', 'request_id': 'req-969b8d07-14ca-497e-b023-ae5758626242'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:25.762915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f994da323194c7ba4e591da484fdb26', 'request_id': 'req-969b8d07-14ca-497e-b023-ae5758626242'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:25.816281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f994da323194c7ba4e591da484fdb26', 'request_id': 'req-969b8d07-14ca-497e-b023-ae5758626242'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:25.829910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] The token cache is being invalidate because project 9f994da323194c7ba4e591da484fdb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:25.830185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:25.830817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:25.832995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 950/1906] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:25 2022] DELETE /identity/v3/projects/9f994da323194c7ba4e591da484fdb26 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:25.837169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:25.852757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a1176-ab37-4e11-9d78-a6c9b0e94ca7 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:25.929262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:25.930663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:25.930940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:25.931208 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] PATH_INFO: `/v3/users/b64073a0144e4f4e9cfe1c0bdd429ece` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:25.933871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64073a0144e4f4e9cfe1c0bdd429ece)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:25.936630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:26.143399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64073a0144e4f4e9cfe1c0bdd429ece'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:26.144852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64073a0144e4f4e9cfe1c0bdd429ece'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:26.181619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64073a0144e4f4e9cfe1c0bdd429ece'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:26.205408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64073a0144e4f4e9cfe1c0bdd429ece'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:26.207434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64073a0144e4f4e9cfe1c0bdd429ece'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:26.321938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 957/1907] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:25 2022] DELETE /identity/v3/users/b64073a0144e4f4e9cfe1c0bdd429ece => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:27.132351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:27.134910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:27.164703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b8d07-14ca-497e-b023-ae5758626242 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:27.238821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:27.239662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.240010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.240378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] PATH_INFO: `/v3/projects/5a299685a69f40609eb2f43838f907bd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.241658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a299685a69f40609eb2f43838f907bd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:27.243874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:27.263290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:27.266335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:27.286864 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd04a21-f96c-4b76-8541-142769375c45 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:27.293191 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:27.294185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.294636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.295067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] PATH_INFO: `/v3/users/5aee089a37fa4c7ca46ff115c1451e57` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.296715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aee089a37fa4c7ca46ff115c1451e57)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:27.299166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:27.468335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:27.481633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a299685a69f40609eb2f43838f907bd', 'request_id': 'req-3d524b95-2e9f-4744-a6c3-f4962c2ac500'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.482227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aee089a37fa4c7ca46ff115c1451e57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.482871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aee089a37fa4c7ca46ff115c1451e57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.488240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a299685a69f40609eb2f43838f907bd', 'request_id': 'req-3d524b95-2e9f-4744-a6c3-f4962c2ac500'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.495593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aee089a37fa4c7ca46ff115c1451e57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.502345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aee089a37fa4c7ca46ff115c1451e57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.503021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b4d6c6-c4df-4eb1-85c9-19ab1b5a149e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aee089a37fa4c7ca46ff115c1451e57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.579126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a299685a69f40609eb2f43838f907bd', 'request_id': 'req-3d524b95-2e9f-4744-a6c3-f4962c2ac500'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.596257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] The token cache is being invalidate because project 5a299685a69f40609eb2f43838f907bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:27.598902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.599631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3d524b95-2e9f-4744-a6c3-f4962c2ac500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:27.601392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 951/1908] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:27 2022] DELETE /identity/v3/projects/5a299685a69f40609eb2f43838f907bd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:27.606537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd00b0f-82af-4fd5-b0fc-24ee58bc926f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.606823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd00b0f-82af-4fd5-b0fc-24ee58bc926f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.607099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd00b0f-82af-4fd5-b0fc-24ee58bc926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.627440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1dd00b0f-82af-4fd5-b0fc-24ee58bc926f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:27.628636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1dd00b0f-82af-4fd5-b0fc-24ee58bc926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:27.637655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:27.647360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 958/1909] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:27 2022] DELETE /identity/v3/users/5aee089a37fa4c7ca46ff115c1451e57 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:27.652050 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.652340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.652616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.671693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:27.673836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:27.689637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 952/1910] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:27.698211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.698496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.698768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.719605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:27.720898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:27.736930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 959/1911] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:27.748498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:27.750092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:27.796942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 953/1912] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:27.800903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:27.812923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564219e8-fb6d-47db-9373-87bbe7adeee4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:27.817860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:27.818499 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.818779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.819161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.820003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:27.820404 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:27.822211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:27.839237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c874c81-9ef6-4626-9c34-7da568b58c1f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:27.842375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 954/1913] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:45:27.842375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:27.844585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:27.845209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.845476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.845947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.856149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d47c68-ac59-4564-a3f2-e7d70ebe3990 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:27.860045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:27.861568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:27.863100 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:27.863879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:27.864165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:27.864437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:27.865153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:27.871251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:27.879854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 960/1914] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:27.963067 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 955/1915] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:27 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:27.964218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:27.974202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc6579-0a40-432f-b4c8-4565dbed2b8e service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.024648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:28.034515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.035189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.035535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.035877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.036675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.038745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.147654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 961/1916] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:27 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:28.151528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.163097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca46309-bb61-41d8-82e4-57e118dc0b26 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.168573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.169266 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.169559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.169883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.170673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.172324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.183561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 956/1917] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:28.187456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.199513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348db60-6719-4650-9ba0-298efb95563b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.204325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.204996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.205335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.205712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.206514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.208161 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.221595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 962/1918] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:28.223032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.234172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad944-dccc-4756-ae46-19eed93d2bf7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.239447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c75a06-1510-4593-b070-515a549cd384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.240111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75a06-1510-4593-b070-515a549cd384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.240395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75a06-1510-4593-b070-515a549cd384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.240678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75a06-1510-4593-b070-515a549cd384 admin admin] PATH_INFO: `/v3/projects/aec43432dff44594a57b59555e0362d4/users/ae10daa3659d4b3c80f541a69eb44ff6/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.259115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75a06-1510-4593-b070-515a549cd384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec43432dff44594a57b59555e0362d4, user_id=ae10daa3659d4b3c80f541a69eb44ff6, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.260313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75a06-1510-4593-b070-515a549cd384 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.383903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.386309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:28.389070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 957/1919] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:28 2022] PUT /identity/v3/projects/aec43432dff44594a57b59555e0362d4/users/ae10daa3659d4b3c80f541a69eb44ff6/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:28.402699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.403323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.403778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.414153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538082d5-83ce-4ad2-9130-561ce4165e90 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.468845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] MFA Rules not processed for user `ae10daa3659d4b3c80f541a69eb44ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:28.470360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:28.485512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.486170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.486636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.486917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] PATH_INFO: `/v3/projects/61802db840994473b6472acc860b6626` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.488077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61802db840994473b6472acc860b6626)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.490205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.514573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:28.549897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 958/1920] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:28.554492 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.564780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe023de4-0592-4c51-8e00-62deff07affe None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.569623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.570747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.571019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.571282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.571899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.573786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.628507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61802db840994473b6472acc860b6626', 'request_id': 'req-80fdbf0b-0028-44c1-9155-7ed698043ae7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:28.635506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61802db840994473b6472acc860b6626', 'request_id': 'req-80fdbf0b-0028-44c1-9155-7ed698043ae7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:28.697147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 959/1921] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:28 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:28.708927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.724628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61802db840994473b6472acc860b6626', 'request_id': 'req-80fdbf0b-0028-44c1-9155-7ed698043ae7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:28.740481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] The token cache is being invalidate because project 61802db840994473b6472acc860b6626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:28.743543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:28.745234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80fdbf0b-0028-44c1-9155-7ed698043ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:28.746830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 963/1922] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:28 2022] DELETE /identity/v3/projects/61802db840994473b6472acc860b6626 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:28.751353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9799-c011-45fc-a28f-a408497074b6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.751762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9799-c011-45fc-a28f-a408497074b6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.752183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9799-c011-45fc-a28f-a408497074b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.772694 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-46dc9799-c011-45fc-a28f-a408497074b6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:28.773675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a74682-eb41-4967-8747-ebdcbf0399a3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.774132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-46dc9799-c011-45fc-a28f-a408497074b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:28.780020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.780526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.780898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.781264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.781940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.783979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.786377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 964/1923] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:28.794803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.795038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.795293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.818053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:28.820528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:28.831698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 965/1924] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:28.835622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.845268 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1825-6b47-4084-b94d-d10e60bbe47a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.850993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.852705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.853047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.853379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.854118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:28.854417 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.855994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.868704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 966/1925] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:45:28.872920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.883663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ba21-5757-4c18-970b-aa4cd0a32247 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.889462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.890428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.890428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.890706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.891281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.893250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.903725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 960/1926] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:28 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:28.906659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.911557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:28.937263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5106f-d068-4a4d-a0c5-3470a9e3dfa1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.942118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.943074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.943331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.943616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.944363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.946072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.956425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 961/1927] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:28.960434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:28.970759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c69178-9056-451a-aa90-518f6c786f56 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:28.975702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:28.976350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:28.977178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:28.977448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:28.978105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:28.993725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:28.993725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 962/1928] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:28.996528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.006254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73fb5-2169-42a5-8842-dc5f75dc7ee4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.010869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f4a5f-4f68-42ea-b5c8-7c627a4e657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.011789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4a5f-4f68-42ea-b5c8-7c627a4e657b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.011789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4a5f-4f68-42ea-b5c8-7c627a4e657b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.012073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f4a5f-4f68-42ea-b5c8-7c627a4e657b admin admin] PATH_INFO: `/v3/projects/096d33178cbf47608d9e98ec518efcf9/users/35769fab701c40d3996bc2d76b0136d0/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.027787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4a5f-4f68-42ea-b5c8-7c627a4e657b admin admin] RBAC: Authorizing `identity:create_grant(project_id=096d33178cbf47608d9e98ec518efcf9, user_id=35769fab701c40d3996bc2d76b0136d0, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.030649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f4a5f-4f68-42ea-b5c8-7c627a4e657b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.035389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 967/1929] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:28 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:29.040041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.055397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:29.110250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6bade-1a6b-4221-a90e-4484317340f6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.115750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.116335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.116614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.117509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.118330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.120091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 963/1930] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:28 2022] PUT /identity/v3/projects/096d33178cbf47608d9e98ec518efcf9/users/35769fab701c40d3996bc2d76b0136d0/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:29.128638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.130446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.130853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.131200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.160062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] MFA Rules not processed for user `35769fab701c40d3996bc2d76b0136d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:29.161251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:29.210605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 968/1931] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:29 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:29.214613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.226739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445881-6326-4932-b655-897ef9cd2b15 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.229893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 964/1932] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:29.234383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.287929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.289235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.289557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.289857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.290516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.292134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.298960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844f564-4e24-47c6-aeb6-da63bf8ba01f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.305088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 969/1933] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:29.306874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.307100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.307661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.308012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.308439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.309048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.311095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.316809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf03e6-f851-4385-a84c-aea247db509a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.321682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.322304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.329334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.329334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.329334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.329334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.336043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 970/1934] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:29.340059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.349687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc9c4-d8d6-40de-a54b-6bdbab513e71 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.354881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d9be-4cee-4b6e-b32c-2367abe49be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.357980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d9be-4cee-4b6e-b32c-2367abe49be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.357980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d9be-4cee-4b6e-b32c-2367abe49be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.357980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d9be-4cee-4b6e-b32c-2367abe49be4 admin admin] PATH_INFO: `/v3/projects/f9bd2708e535433d96577751c52ce839/users/9e59711f0c844bffba9532a4709039c3/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.371547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d9be-4cee-4b6e-b32c-2367abe49be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bd2708e535433d96577751c52ce839, user_id=9e59711f0c844bffba9532a4709039c3, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.374256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d9be-4cee-4b6e-b32c-2367abe49be4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.465819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 965/1935] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:29 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:29.469841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.529670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:29.531347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 971/1936] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:29 2022] PUT /identity/v3/projects/f9bd2708e535433d96577751c52ce839/users/9e59711f0c844bffba9532a4709039c3/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:29.535114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af89b8-f677-4879-b736-48fe95f4b0d2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.543494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.543758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.544021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.574669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] MFA Rules not processed for user `9e59711f0c844bffba9532a4709039c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:29.575509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:29.614329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.615050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.615393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.615763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.616497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.619054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.661968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 972/1937] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:29.675299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.676873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:29.756116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5beb54-549f-4f02-b8cc-d536bb620bfe None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.760628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 966/1938] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:29 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:29.763147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.763768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.764094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.764462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.766126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.776806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca922a9-fa50-4d06-9ce8-6f63d2998bfe admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.780960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.782190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.782725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.782834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.783055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.783326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.784008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.785809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.798363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 967/1939] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:29.802347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.802922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 973/1940] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:45:29.825953 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af572-8515-4cce-9b5d-4f1a0088b672 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.831821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.832708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.833141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.833417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] PATH_INFO: `/v3/projects/925573706b804022bbb02db2d4f478e3/users/ca97c257103b4f699dd5a3cceac9e347/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.835507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:29.849771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421338-a51e-4656-ab4b-d9c161582a31 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:29.850744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925573706b804022bbb02db2d4f478e3, user_id=ca97c257103b4f699dd5a3cceac9e347, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.854922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.857114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:29.857980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:29.858664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:29.859044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] PATH_INFO: `/v3/users/9e59711f0c844bffba9532a4709039c3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:29.861366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e59711f0c844bffba9532a4709039c3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:29.863443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:29.958995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 968/1941] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:29 2022] PUT /identity/v3/projects/925573706b804022bbb02db2d4f478e3/users/ca97c257103b4f699dd5a3cceac9e347/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:29.963332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:30.036712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237663-ae76-426e-8fdd-44c290709b62 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:30.041520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:30.042151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:30.042436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:30.042713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:30.043381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:30.044975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:30.055208 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 969/1942] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:30.059187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:30.068711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c78fe2-5468-447f-b5a8-ac78ec3280ef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:30.074205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1424ddb-4450-4601-a81f-130196c71a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:30.074853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424ddb-4450-4601-a81f-130196c71a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:30.075134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424ddb-4450-4601-a81f-130196c71a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:30.075410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424ddb-4450-4601-a81f-130196c71a63 admin admin] PATH_INFO: `/v3/projects/925573706b804022bbb02db2d4f478e3/users/ca97c257103b4f699dd5a3cceac9e347/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:30.077319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1424ddb-4450-4601-a81f-130196c71a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925573706b804022bbb02db2d4f478e3, user_id=ca97c257103b4f699dd5a3cceac9e347, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:30.079995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1424ddb-4450-4601-a81f-130196c71a63 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:30.091774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 970/1943] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:30 2022] PUT /identity/v3/projects/925573706b804022bbb02db2d4f478e3/users/ca97c257103b4f699dd5a3cceac9e347/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:30.103956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:30.104370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:30.104650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:30.132001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] MFA Rules not processed for user `ca97c257103b4f699dd5a3cceac9e347`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:30.133717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:30.166723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e59711f0c844bffba9532a4709039c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:30.173144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e59711f0c844bffba9532a4709039c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:30.179500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e59711f0c844bffba9532a4709039c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:30.186277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e59711f0c844bffba9532a4709039c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:30.186938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e59711f0c844bffba9532a4709039c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:30.201156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 971/1944] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:30.212538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:30.213856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:30.269528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156263c1-e3b8-4bec-a2a0-df65058e1b08 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:30.273978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdbd6f-8668-4c3b-9d73-5ec271b0a2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:30.274575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdbd6f-8668-4c3b-9d73-5ec271b0a2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:30.274848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdbd6f-8668-4c3b-9d73-5ec271b0a2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:30.275114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdbd6f-8668-4c3b-9d73-5ec271b0a2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:30.284093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdbd6f-8668-4c3b-9d73-5ec271b0a2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:30.287753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdbd6f-8668-4c3b-9d73-5ec271b0a2e3 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:30.294843 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 972/1945] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:45:30.313028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 974/1946] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:29 2022] DELETE /identity/v3/users/9e59711f0c844bffba9532a4709039c3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:30.317331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:30.317648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:30.317924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:30.338002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:30.339188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:30.400368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 973/1947] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:30.410254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:30.411722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:30.439073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:30.470075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc519ac0-d6d0-45a4-80a0-eb9706a93803 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:30.473617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:30.474223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:30.474499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:30.474767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:30.483574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:30.484929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:30.495003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 975/1948] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:30.536377 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:30.842065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:31.031565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:31.038201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:31.045333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec283c-f19c-495b-84ce-a13d274ce156 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:31.050053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:31.050785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:31.050966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:31.051244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] PATH_INFO: `/v3/projects/f9bd2708e535433d96577751c52ce839` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:31.052386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9bd2708e535433d96577751c52ce839)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:31.055204 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:31.179280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bd2708e535433d96577751c52ce839', 'request_id': 'req-a8300fa8-7343-4b89-9532-97376bb13542'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:31.186044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bd2708e535433d96577751c52ce839', 'request_id': 'req-a8300fa8-7343-4b89-9532-97376bb13542'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:31.279907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bd2708e535433d96577751c52ce839', 'request_id': 'req-a8300fa8-7343-4b89-9532-97376bb13542'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:31.291756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] The token cache is being invalidate because project f9bd2708e535433d96577751c52ce839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:31.292124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:31.293172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8300fa8-7343-4b89-9532-97376bb13542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:31.294373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 974/1949] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:31 2022] DELETE /identity/v3/projects/f9bd2708e535433d96577751c52ce839 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:31.638829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:31.640244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:31.651171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:31.696199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c680b-b330-4827-9fbb-c9128de1fe06 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:31.743600 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:31.744202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:31.744480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:31.744748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:31.746490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:31.803389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:31.805588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:31.815106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 976/1950] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:34.759041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6840b29-7566-44ba-a852-983501f73950 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:34.759934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6840b29-7566-44ba-a852-983501f73950 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:34.760412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6840b29-7566-44ba-a852-983501f73950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:34.780121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a6840b29-7566-44ba-a852-983501f73950 None None] MFA Rules not processed for user `3d7238669a7c4367872b92e5084d5422`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:34.781333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a6840b29-7566-44ba-a852-983501f73950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:34.857821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 975/1951] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:36.798837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:36.800461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:36.871435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca547-57e0-4751-8ddd-d10d20fe6b3d service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:36.876042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:36.876770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:36.877052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:36.877325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] PATH_INFO: `/v3/users/92222f9af7d54f978e7529d030228db1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:36.878559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=92222f9af7d54f978e7529d030228db1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:36.880580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:36.909359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:37.113921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92222f9af7d54f978e7529d030228db1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:37.114891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92222f9af7d54f978e7529d030228db1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:37.128079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92222f9af7d54f978e7529d030228db1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:37.146187 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92222f9af7d54f978e7529d030228db1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:37.146930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92222f9af7d54f978e7529d030228db1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:37.228894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 977/1952] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:36 2022] DELETE /identity/v3/users/92222f9af7d54f978e7529d030228db1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:37.233601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eec14-6e6c-40fe-9800-8788445e93e7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:37.234013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eec14-6e6c-40fe-9800-8788445e93e7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:37.234099 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eec14-6e6c-40fe-9800-8788445e93e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:37.255465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3f9eec14-6e6c-40fe-9800-8788445e93e7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:37.256666 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3f9eec14-6e6c-40fe-9800-8788445e93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:37.262311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:37.323768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 976/1953] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:37.333467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:37.335459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:37.396093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950416-d939-4a9d-8516-68e3b2dc80bb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:37.400915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:37.401167 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:37.401442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:37.401744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:37.411366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:37.413894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:37.424172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 978/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:37.652093 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25a635-1a21-4cb2-88d9-769ce661d266 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:37.652390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25a635-1a21-4cb2-88d9-769ce661d266 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:37.652829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25a635-1a21-4cb2-88d9-769ce661d266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:37.678079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8b25a635-1a21-4cb2-88d9-769ce661d266 None None] MFA Rules not processed for user `429fa7f2640a4b8d9e9ad48002bf2425`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:37.678079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8b25a635-1a21-4cb2-88d9-769ce661d266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:37.743041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 977/1955] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:37.984199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:37.986327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:38.015264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576618-edae-4b6b-8dd4-4e251be89a08 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.029352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.030695 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.036186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.036186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] PATH_INFO: `/v3/projects/759de22996724ce8af78d861dd186c92` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.036186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=759de22996724ce8af78d861dd186c92)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.038963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:38.199147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759de22996724ce8af78d861dd186c92', 'request_id': 'req-cda42aca-54b2-4736-9398-c5acbdd5e23b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:38.210437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759de22996724ce8af78d861dd186c92', 'request_id': 'req-cda42aca-54b2-4736-9398-c5acbdd5e23b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:38.307253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759de22996724ce8af78d861dd186c92', 'request_id': 'req-cda42aca-54b2-4736-9398-c5acbdd5e23b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:38.318443 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] The token cache is being invalidate because project 759de22996724ce8af78d861dd186c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:38.318786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:38.319955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cda42aca-54b2-4736-9398-c5acbdd5e23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:38.321452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 979/1956] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:37 2022] DELETE /identity/v3/projects/759de22996724ce8af78d861dd186c92 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:38.326311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.326777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.326868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.347790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:38.348824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:38.409689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 978/1957] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:38.417652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.417967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.418284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.439092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:38.440318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:38.449938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 980/1958] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:38.455519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:38.466402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353462ca-3b63-4c95-8a9f-5995cc08da50 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.471576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.472200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.472490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.472799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.473447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:38.473792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.475450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:38.487737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 979/1959] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:45:38.492168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:38.501793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afa2bf-f537-45a1-a902-b815bdc21538 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.506496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.507632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.507908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.508176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.508808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.510757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:38.528549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:38.637856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 981/1960] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:38 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:38.641837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:38.651870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ddeac-dc3a-4615-b2f1-354a7e662f9d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.694200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:38.710339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.711019 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.711297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.711583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.712224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.714263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:38.802799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 980/1961] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:38 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:38.804860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:38.826817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1807a13-501b-4201-8f4b-0f9fd3490e1c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.833837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.834570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.837876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.838430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.839451 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.841326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:38.853743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 982/1962] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:38.867562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:38.878367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5e28-4b89-4486-b9de-5d87bbe115be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.884459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741de09-9b9c-45f2-af23-bd7408268385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.885487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741de09-9b9c-45f2-af23-bd7408268385 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.885487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741de09-9b9c-45f2-af23-bd7408268385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.885671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741de09-9b9c-45f2-af23-bd7408268385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.886414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741de09-9b9c-45f2-af23-bd7408268385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.888103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741de09-9b9c-45f2-af23-bd7408268385 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:38.900389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 981/1963] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:38.911898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:38.923534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b1a2b-c5f5-40c0-b546-2d2b14e908a7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:38.929484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:38.930249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:38.930605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:38.930952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] PATH_INFO: `/v3/projects/0613f9b616224106acf35f00129287b8/users/31d38e260f444f43b806fbf27104b633/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:38.948440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0613f9b616224106acf35f00129287b8, user_id=31d38e260f444f43b806fbf27104b633, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:38.952123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:39.067238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 983/1964] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:38 2022] PUT /identity/v3/projects/0613f9b616224106acf35f00129287b8/users/31d38e260f444f43b806fbf27104b633/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:39.082312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:39.085783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:39.086303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:39.126006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:39.127737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.159363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] MFA Rules not processed for user `31d38e260f444f43b806fbf27104b633`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:39.161239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.237424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7859d07-e26a-482f-8e90-68b49e84f826 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:39.252579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:39.253228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:39.253507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:39.253803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] PATH_INFO: `/v3/users/d2822a4219d54633a840a749f9e2b104` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:39.258420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2822a4219d54633a840a749f9e2b104)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:39.260761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:39.265581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 982/1965] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:39.280305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:39.282033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.349425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabde6d4-a254-4f15-b3ed-58fe34cf2363 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:39.353159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:39.353835 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:39.354115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:39.354386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:39.362525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:39.363928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:39.376172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 983/1966] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:45:39.419020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:39.420504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.432923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36392-a0cc-41f4-889d-9f4053ec0dd8 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:39.438048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:39.438648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:39.438923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:39.442177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:39.442177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.507788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:39.511800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:39.513862 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d2810-80bf-4fa3-a8cb-1f098b1b8486 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:39.524399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 984/1967] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:45:39.536874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2822a4219d54633a840a749f9e2b104'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:39.537740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2822a4219d54633a840a749f9e2b104'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:39.550296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2822a4219d54633a840a749f9e2b104'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:39.558115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2822a4219d54633a840a749f9e2b104'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:39.558934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2822a4219d54633a840a749f9e2b104'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:39.714762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 984/1968] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:39 2022] DELETE /identity/v3/users/d2822a4219d54633a840a749f9e2b104 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:39.719853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:39.720151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:39.720434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:39.740922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:39.743015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.804444 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 985/1969] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:39.814225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:39.815995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:39.874780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:39.889166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d2e26-c630-4228-b055-2be074f796a1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:39.892760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089406-4035-48f9-810f-2d9e1fbc0108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:39.893364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089406-4035-48f9-810f-2d9e1fbc0108 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:39.893676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089406-4035-48f9-810f-2d9e1fbc0108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:39.893952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089406-4035-48f9-810f-2d9e1fbc0108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:39.903229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089406-4035-48f9-810f-2d9e1fbc0108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:39.904677 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089406-4035-48f9-810f-2d9e1fbc0108 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:39.915234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 985/1970] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:40.374528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:40.376097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:40.406162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc6a1-a552-4671-b628-8e67da672c1c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:40.415947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:40.416970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:40.417427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:40.417926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] PATH_INFO: `/v3/projects/157a5875c96e428db29fa60f9b7f8851` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:40.428350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=157a5875c96e428db29fa60f9b7f8851)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:40.428350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:40.575491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157a5875c96e428db29fa60f9b7f8851', 'request_id': 'req-b4e9da75-2c36-4c65-a803-6ce88a109f0f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:40.583103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157a5875c96e428db29fa60f9b7f8851', 'request_id': 'req-b4e9da75-2c36-4c65-a803-6ce88a109f0f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:40.660998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157a5875c96e428db29fa60f9b7f8851', 'request_id': 'req-b4e9da75-2c36-4c65-a803-6ce88a109f0f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:40.673692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] The token cache is being invalidate because project 157a5875c96e428db29fa60f9b7f8851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:40.673981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:40.674646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b4e9da75-2c36-4c65-a803-6ce88a109f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:40.680061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 986/1971] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:40 2022] DELETE /identity/v3/projects/157a5875c96e428db29fa60f9b7f8851 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:40.681799 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:40.682234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:40.682361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:40.704157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:40.705371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:40.770338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 986/1972] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:40.778877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:40.779206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:40.779470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:40.800293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:40.801737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:40.810135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 987/1973] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:40.815717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:40.832312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cdb9a-a44a-407f-9f78-37e4b3bf247c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:40.844060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:40.844585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:40.844874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:40.845691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:40.846355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:40.846753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:40.848405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:40.861243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 987/1974] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:45:40.865614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:40.875998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a41b9-de0a-4a24-a263-aeaf4e1b8dc1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:40.882362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:40.883037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:40.883378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:40.883711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:40.884411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:40.886403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:40.965272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 988/1975] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:40 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:40.969608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:40.979465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b4c48-ac68-4f10-9ce5-45f925b13df5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:41.039016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:41.039649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:41.039926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:41.040195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:41.040833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:41.042786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:41.127211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 988/1976] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:40 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:41.131038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:41.141705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faecdb1-8aaf-41ec-ba17-ea17d81fbf68 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:41.146280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:41.146864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:41.148228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:41.148228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:41.148228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:41.149830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:41.159758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 989/1977] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:41.163920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:41.174670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9995-d60a-48f3-aabb-1f40de1b3230 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:41.180087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1757-0954-4d01-a8c4-25ebc83d6919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:41.180736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1757-0954-4d01-a8c4-25ebc83d6919 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:41.181013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1757-0954-4d01-a8c4-25ebc83d6919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:41.181278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1757-0954-4d01-a8c4-25ebc83d6919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:41.181944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1757-0954-4d01-a8c4-25ebc83d6919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:41.183555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1757-0954-4d01-a8c4-25ebc83d6919 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:41.195029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 989/1978] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:41.199293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:41.214654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a8607-0f42-4096-b711-897610b9cb5d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:41.214654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:41.214916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:41.215066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:41.215323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] PATH_INFO: `/v3/projects/e9a9412338e142e0b4f5e53b6e1c0fce/users/04e43bb9ba8f42d99bf1760a82b1eec0/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:41.233611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a9412338e142e0b4f5e53b6e1c0fce, user_id=04e43bb9ba8f42d99bf1760a82b1eec0, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:41.236356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:41.351915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 990/1979] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:41 2022] PUT /identity/v3/projects/e9a9412338e142e0b4f5e53b6e1c0fce/users/04e43bb9ba8f42d99bf1760a82b1eec0/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:41.366868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee7fc-cde6-4b08-a0d5-1607269888f4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:41.366868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee7fc-cde6-4b08-a0d5-1607269888f4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:41.366868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee7fc-cde6-4b08-a0d5-1607269888f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:41.392138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3e4ee7fc-cde6-4b08-a0d5-1607269888f4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:41.394333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3e4ee7fc-cde6-4b08-a0d5-1607269888f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:41.470051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:41.485964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 990/1980] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:41.496137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:41.498002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:41.512376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:41.573505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a137f-4f1c-4b75-bde8-7a93d363c323 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:41.573505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:41.573505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:41.573505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:41.574018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:41.575569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:41.576976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:41.586505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 991/1981] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:42.904384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:42.904874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:42.904969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:42.943329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] MFA Rules not processed for user `04e43bb9ba8f42d99bf1760a82b1eec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:42.944801 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:43.046735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 991/1982] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:43.410946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:43.413411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:43.471144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afd6cc-4640-4a8c-b042-c123013674c9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:43.474678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1ba7e-2192-45e6-a4b4-b89b543a1a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:43.475993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1ba7e-2192-45e6-a4b4-b89b543a1a1f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:43.476270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1ba7e-2192-45e6-a4b4-b89b543a1a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:43.476539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1ba7e-2192-45e6-a4b4-b89b543a1a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:43.484853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1ba7e-2192-45e6-a4b4-b89b543a1a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:43.486296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1ba7e-2192-45e6-a4b4-b89b543a1a1f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:43.495281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 992/1983] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:44.241234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:44.244137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:44.278087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f17e9-0885-4011-9a26-6cf8d763ad2b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:44.284003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:44.285179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:44.285457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:44.285760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] PATH_INFO: `/v3/users/ae10daa3659d4b3c80f541a69eb44ff6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:44.288195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae10daa3659d4b3c80f541a69eb44ff6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:44.290468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:44.567152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae10daa3659d4b3c80f541a69eb44ff6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:44.568344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae10daa3659d4b3c80f541a69eb44ff6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:44.582708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae10daa3659d4b3c80f541a69eb44ff6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:44.590297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae10daa3659d4b3c80f541a69eb44ff6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:44.591021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae10daa3659d4b3c80f541a69eb44ff6'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:44.674419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 992/1984] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:44 2022] DELETE /identity/v3/users/ae10daa3659d4b3c80f541a69eb44ff6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:44.679878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:44.682254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:44.682755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:44.710720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:44.712567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:44.782833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 993/1985] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:44.793469 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:44.795056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:44.853348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef589beb-ae6a-4df3-9168-5c47c2f61a02 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:44.857411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:44.858136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:44.859956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:44.859956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:44.865832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:44.869456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:44.870956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:44.882286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 993/1986] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:45.462736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:45.464371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:45.476941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2dc29-e7f7-4257-ae9f-11101bb43188 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:45.483667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:45.486295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:45.487174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:45.487686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] PATH_INFO: `/v3/projects/aec43432dff44594a57b59555e0362d4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:45.489080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec43432dff44594a57b59555e0362d4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:45.491653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:45.627408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec43432dff44594a57b59555e0362d4', 'request_id': 'req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:45.634920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec43432dff44594a57b59555e0362d4', 'request_id': 'req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:45.636794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:45.772515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec43432dff44594a57b59555e0362d4', 'request_id': 'req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:45.784072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] The token cache is being invalidate because project aec43432dff44594a57b59555e0362d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:45.784362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:45.785025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ae4a15ab-7b3c-4888-8e2b-4d0bd0001b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:45.786554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 994/1987] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:45 2022] DELETE /identity/v3/projects/aec43432dff44594a57b59555e0362d4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:45.791140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:45.800887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298a67-94c2-4b77-89c7-7431a9959708 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:45.860747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:45.861416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:45.861840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:45.862119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] PATH_INFO: `/v3/users/35769fab701c40d3996bc2d76b0136d0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:45.863225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35769fab701c40d3996bc2d76b0136d0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:45.865129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:46.039890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35769fab701c40d3996bc2d76b0136d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:46.040541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35769fab701c40d3996bc2d76b0136d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:46.064054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35769fab701c40d3996bc2d76b0136d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:46.086575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35769fab701c40d3996bc2d76b0136d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:46.087511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35769fab701c40d3996bc2d76b0136d0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:46.172963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 994/1988] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:45 2022] DELETE /identity/v3/users/35769fab701c40d3996bc2d76b0136d0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:46.404105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:46.404392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:46.404849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:46.440707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] MFA Rules not processed for user `04e43bb9ba8f42d99bf1760a82b1eec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:46.441951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:46.530400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 995/1989] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:46.919399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:46.921988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:47.017844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a173b6-8cbc-4c55-8112-c2a7f21ed0d7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:47.027212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:47.028086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:47.028278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:47.028603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] PATH_INFO: `/v3/projects/096d33178cbf47608d9e98ec518efcf9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:47.029827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096d33178cbf47608d9e98ec518efcf9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:47.031926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:47.059349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:47.192474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096d33178cbf47608d9e98ec518efcf9', 'request_id': 'req-5d7c54cf-0ec5-420b-b156-430286372f41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.201442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096d33178cbf47608d9e98ec518efcf9', 'request_id': 'req-5d7c54cf-0ec5-420b-b156-430286372f41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.289428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096d33178cbf47608d9e98ec518efcf9', 'request_id': 'req-5d7c54cf-0ec5-420b-b156-430286372f41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.301060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] The token cache is being invalidate because project 096d33178cbf47608d9e98ec518efcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:47.301486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.302440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.307626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 995/1990] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:46 2022] DELETE /identity/v3/projects/096d33178cbf47608d9e98ec518efcf9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:47.309297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:47.323723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e32bb1-979c-4efe-bd78-fec8c5c798ba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:47.383020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:47.383655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:47.383936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:47.384211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] PATH_INFO: `/v3/users/ca97c257103b4f699dd5a3cceac9e347` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:47.387999 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca97c257103b4f699dd5a3cceac9e347)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:47.390151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:47.647606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca97c257103b4f699dd5a3cceac9e347'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.648467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca97c257103b4f699dd5a3cceac9e347'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.665855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca97c257103b4f699dd5a3cceac9e347'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.739238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca97c257103b4f699dd5a3cceac9e347'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.744651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-42bd0ef6-83a6-4800-ae2c-e4fb27e5ebc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca97c257103b4f699dd5a3cceac9e347'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:47.751854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 996/1991] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:47 2022] DELETE /identity/v3/users/ca97c257103b4f699dd5a3cceac9e347 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:48.213853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:48.215296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:48.236714 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c54cf-0ec5-420b-b156-430286372f41 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:48.298565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:48.299459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.299926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.300193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] PATH_INFO: `/v3/projects/925573706b804022bbb02db2d4f478e3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.301357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925573706b804022bbb02db2d4f478e3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:48.303457 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:48.414059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925573706b804022bbb02db2d4f478e3', 'request_id': 'req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:48.420462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925573706b804022bbb02db2d4f478e3', 'request_id': 'req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:48.482751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925573706b804022bbb02db2d4f478e3', 'request_id': 'req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:48.494334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] The token cache is being invalidate because project 925573706b804022bbb02db2d4f478e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:48.494620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:48.495253 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e3f19fe-6b4e-49c9-86bf-b1fa35af1f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:48.496753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 996/1992] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:48 2022] DELETE /identity/v3/projects/925573706b804022bbb02db2d4f478e3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:48.504024 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.504508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.504597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.518924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:48.525848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:48.526844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:48.585115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 997/1993] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:48.593887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18535136-3a8b-4c72-a055-16414b812561 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.594174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18535136-3a8b-4c72-a055-16414b812561 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.594450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18535136-3a8b-4c72-a055-16414b812561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.614264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-18535136-3a8b-4c72-a055-16414b812561 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:48.615961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-18535136-3a8b-4c72-a055-16414b812561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:48.624015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 997/1994] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:48.628417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:48.638995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba569a-3593-43ae-bd68-41fdde7a7ac8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:48.643579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:48.644170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.644448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.644722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.645359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:48.645693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:48.647390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:48.659280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 998/1995] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:45:48.663502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18535136-3a8b-4c72-a055-16414b812561 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:48.672648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18535136-3a8b-4c72-a055-16414b812561 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:48.677209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:48.678330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.678611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.678878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.679497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:48.681364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:48.782711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 998/1996] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:48 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:48.784438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:48.795510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ff62c-7048-4466-a3e3-ef6de39d0d9c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:48.851554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:48.852169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.852427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.852694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.853325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:48.855249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:48.949163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 999/1997] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:48 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:48.953353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:48.960030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:48.963710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3f12b-c71b-45f1-9aa2-389a7809e93b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:48.968589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:48.969173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:48.970593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:48.970593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:48.970593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:48.971928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:48.982343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 999/1998] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:48.986225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:48.997224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc00fb-11a3-46c3-a295-fea77fdb3998 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.002413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5b9e5-5449-4dc5-8841-305bf977e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.003015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5b9e5-5449-4dc5-8841-305bf977e429 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.003297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5b9e5-5449-4dc5-8841-305bf977e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.003574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5b9e5-5449-4dc5-8841-305bf977e429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.004258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5b9e5-5449-4dc5-8841-305bf977e429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.005881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5b9e5-5449-4dc5-8841-305bf977e429 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.016877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1000/1999] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:49.021065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.031203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e550c7-dc2b-441e-8823-3dbc6caf9acd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.035720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.039617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.039617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.039617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] PATH_INFO: `/v3/projects/de1ac6d8840542b9ba7a4fb3eb1dfff8/users/ff1201dc828b4f2dad98fe7e91e67770/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.052437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1ac6d8840542b9ba7a4fb3eb1dfff8, user_id=ff1201dc828b4f2dad98fe7e91e67770, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.055935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.140459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1000/2000] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:49 2022] PUT /identity/v3/projects/de1ac6d8840542b9ba7a4fb3eb1dfff8/users/ff1201dc828b4f2dad98fe7e91e67770/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:49.152347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.152637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.152914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.182057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] MFA Rules not processed for user `ff1201dc828b4f2dad98fe7e91e67770`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:49.183274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:49.248723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1001/2001] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:49.253243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.321156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82574ef-556b-4dac-ba52-678590894d12 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.326042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.326646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.326924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.327283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.327938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.329917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.438503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1001/2002] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:49 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:49.442587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.448125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:49.453917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b55fc-57ff-4b48-872f-a67a915ebe1d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.514680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.515299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.515557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.515831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.516552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.518517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.608969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1002/2003] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:49 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:49.612879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.623351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f84ac6-5ea3-4c70-865e-fc0020d787e0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.627979 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.628566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.628843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.629113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.629838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.631944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.642520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1002/2004] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:49.646545 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.657385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7601b-28b5-4e5c-bf66-0e6522e70657 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.662661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db58ad-dcfc-41e8-a910-0043445ca26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.663259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db58ad-dcfc-41e8-a910-0043445ca26f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.663544 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db58ad-dcfc-41e8-a910-0043445ca26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.663823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db58ad-dcfc-41e8-a910-0043445ca26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.664467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db58ad-dcfc-41e8-a910-0043445ca26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.666135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db58ad-dcfc-41e8-a910-0043445ca26f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.676112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1003/2005] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:49.680237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.690261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f18882-e374-48ea-b4d1-e3f9e58a81da admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.695224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.695857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.696135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.696405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] PATH_INFO: `/v3/projects/54dc3ceeb3084ed19db6f9ffbfa34aeb/users/7dda1101562540acb5496903cfe05dc0/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.710960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dc3ceeb3084ed19db6f9ffbfa34aeb, user_id=7dda1101562540acb5496903cfe05dc0, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.713641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:49.783088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1003/2006] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:49 2022] PUT /identity/v3/projects/54dc3ceeb3084ed19db6f9ffbfa34aeb/users/7dda1101562540acb5496903cfe05dc0/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:49.794195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.794487 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.794769 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.823744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] MFA Rules not processed for user `7dda1101562540acb5496903cfe05dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:49.824939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:49.894581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1004/2007] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:49.898989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:49.964553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02c26-e2a0-4002-bc34-5f6744514f46 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:49.969807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:49.970404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:49.970686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:49.970962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:49.971637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:49.973528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.070175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1004/2008] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:49 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:50.074304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.084830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea040b-b66a-4159-af8b-eb35358b7392 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.140887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.141482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.141783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.142105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.142806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.144691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.247190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:50.252275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1005/2009] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:50 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:45:50.256372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.263503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:50.267046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d817-cbe9-4a72-8432-1502fe19f5e6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.271715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.272320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.272603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.272878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.273576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.275186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.286022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1005/2010] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:50.291034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.301016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebac671-e684-4b91-b40c-46977b4f8789 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.306870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.307531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.307807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.308079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] PATH_INFO: `/v3/projects/fba0933f6ec841998ab589ec29f168f5/users/cd808f35074d424fbd2a80284598c40b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.323754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba0933f6ec841998ab589ec29f168f5, user_id=cd808f35074d424fbd2a80284598c40b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.326559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.434358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1006/2011] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:50 2022] PUT /identity/v3/projects/fba0933f6ec841998ab589ec29f168f5/users/cd808f35074d424fbd2a80284598c40b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:50.438304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.449138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956e35d-3534-444b-afec-9c8c53b00a0e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.511490 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6948e2-33fd-4f08-89bf-6dc321e793b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.512100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6948e2-33fd-4f08-89bf-6dc321e793b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.512384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6948e2-33fd-4f08-89bf-6dc321e793b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.512660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6948e2-33fd-4f08-89bf-6dc321e793b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.513299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6948e2-33fd-4f08-89bf-6dc321e793b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.514929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6948e2-33fd-4f08-89bf-6dc321e793b1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.524858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1006/2012] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:45:50.529267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.540210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da7ff4-e7f9-46e6-bc6b-8921913217e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.544719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.545434 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.545719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.545995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] PATH_INFO: `/v3/projects/fba0933f6ec841998ab589ec29f168f5/users/cd808f35074d424fbd2a80284598c40b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.547861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba0933f6ec841998ab589ec29f168f5, user_id=cd808f35074d424fbd2a80284598c40b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.550645 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.561268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1007/2013] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:50 2022] PUT /identity/v3/projects/fba0933f6ec841998ab589ec29f168f5/users/cd808f35074d424fbd2a80284598c40b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:50.571531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.571824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.572100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.600809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] MFA Rules not processed for user `cd808f35074d424fbd2a80284598c40b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:50.602491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:50.679617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1007/2014] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:50.696906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.701059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:50.772361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb043a-89c9-4f68-99dc-8417ea151754 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.776015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39695c64-d3d7-4f4b-b5c0-64fdac772a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.776620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39695c64-d3d7-4f4b-b5c0-64fdac772a67 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.776953 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39695c64-d3d7-4f4b-b5c0-64fdac772a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.777224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39695c64-d3d7-4f4b-b5c0-64fdac772a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.832375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39695c64-d3d7-4f4b-b5c0-64fdac772a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.833882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39695c64-d3d7-4f4b-b5c0-64fdac772a67 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.843674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1008/2015] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:51.767046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:51.768869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:51.846816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0906-b366-418a-a9c9-8b2ac0615147 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:51.852644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:51.853284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:51.853581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:51.853916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] PATH_INFO: `/v3/users/31d38e260f444f43b806fbf27104b633` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:51.855055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d38e260f444f43b806fbf27104b633)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:51.857015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:51.875768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:52.108916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d38e260f444f43b806fbf27104b633'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:52.109701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d38e260f444f43b806fbf27104b633'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:52.123074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d38e260f444f43b806fbf27104b633'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:52.130280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d38e260f444f43b806fbf27104b633'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:52.131645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d38e260f444f43b806fbf27104b633'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:52.188511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1008/2016] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:45:51 2022] DELETE /identity/v3/users/31d38e260f444f43b806fbf27104b633 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:52.193020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:52.194110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:52.194247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:52.213008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:52.214227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:52.276248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1009/2017] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:45:52.286276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:52.287932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:52.352887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5fb34-ecbc-4b04-a33d-f0675f5b899f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:52.386283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ed564-1c2d-4da9-a850-c6375367f19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:52.386283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ed564-1c2d-4da9-a850-c6375367f19d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:52.386283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ed564-1c2d-4da9-a850-c6375367f19d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:52.386283 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ed564-1c2d-4da9-a850-c6375367f19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:52.386682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ed564-1c2d-4da9-a850-c6375367f19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:52.386682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ed564-1c2d-4da9-a850-c6375367f19d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:52.386682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1009/2018] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:53.201960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:53.204171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:53.217888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fecf59-d2e9-46a3-ad78-d18024dde4e8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:53.227625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:53.228270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.228765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.229044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] PATH_INFO: `/v3/projects/0613f9b616224106acf35f00129287b8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.230907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0613f9b616224106acf35f00129287b8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:53.233137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:53.245235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:53.355746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0613f9b616224106acf35f00129287b8', 'request_id': 'req-5b506658-2ec7-4a87-9e65-7365c44b9a81'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:53.365218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0613f9b616224106acf35f00129287b8', 'request_id': 'req-5b506658-2ec7-4a87-9e65-7365c44b9a81'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:53.467071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0613f9b616224106acf35f00129287b8', 'request_id': 'req-5b506658-2ec7-4a87-9e65-7365c44b9a81'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:53.483925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] The token cache is being invalidate because project 0613f9b616224106acf35f00129287b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:45:53.484218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:53.484880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b506658-2ec7-4a87-9e65-7365c44b9a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:45:53.486604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1010/2019] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:45:53 2022] DELETE /identity/v3/projects/0613f9b616224106acf35f00129287b8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:45:53.491555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.498620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.498620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.512882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:53.514116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:53.576763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1010/2020] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:53.585435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.590495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.590495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.605976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:53.607203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:53.614910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1011/2021] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:53.619742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:53.631607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6ccf3-165e-42d6-832f-b330624a48a7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:53.636252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:53.636896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.637181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.637437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.638102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:45:53.638401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:53.639978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:53.652397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1011/2022] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:45:53.658105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:53.670155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8c5e3-b13e-40e5-8ad5-3766f0e20646 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:53.677137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:53.677137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.678590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.678590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.678774 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:53.680614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:53.783878 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1012/2023] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:45:53 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:53.787726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:53.804497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d2b7d-d278-4dd7-a346-6bdc8ba747c3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:53.826742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:53.868212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:53.868954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.869327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.869728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.870554 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:53.873061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:53.964308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1012/2024] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:45:53 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:45:53.965646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:53.988541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a399-9881-4147-a4f8-fa66978ad4df admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:53.991205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:53.992285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:53.993017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:53.993348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:53.994169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:53.995836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.007682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:54.009468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.017594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1013/2025] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:54.023581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:54.034877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc721a-cb81-42e5-835a-0aa5bc384aae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:54.040081 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:54.040846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.041130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.041420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.042092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:54.045486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.055982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1014/2026] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:45:54.060027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:54.071529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd808a-5f44-4167-bc65-edc03ac86884 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:54.077496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49ff6d-fafa-4684-809e-9290525fd680 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:54.078702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:54.079606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.080091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.080683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] PATH_INFO: `/v3/projects/a1f75d1b0bd043808176160925a03289/users/a972f1b3086548a28279d52670296f32/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.081436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:54.082098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.082379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.082655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.084699 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.103725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f75d1b0bd043808176160925a03289, user_id=a972f1b3086548a28279d52670296f32, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:54.118909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.163542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:54.165449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfb18c-b36f-47ac-986c-90be1fe4e8d2 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.178888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1013/2027] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:45:54.212485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1015/2028] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:45:54 2022] PUT /identity/v3/projects/a1f75d1b0bd043808176160925a03289/users/a972f1b3086548a28279d52670296f32/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:45:54.222988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.223185 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.223533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.261466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] MFA Rules not processed for user `a972f1b3086548a28279d52670296f32`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:54.264545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.345366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1014/2029] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:45:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:54.357468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:54.359523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.449964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085200-aa6d-481b-9196-246851ffc2b9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:54.453821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:54.454464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.454943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.455277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.464617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:54.466264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.475818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1016/2030] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:54.629220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:55.662740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:55.673383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167af6c-8df7-4a93-b3ad-bcc798b1a865 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:55.679585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:55.680332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:55.680691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:55.681112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:55.683031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:55.750724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:55.752154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1a6ee-93f3-4d48-9cd2-16e4b9bbde56 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:55.762643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1015/2031] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:01.436202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:01.437621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:01.469223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:01.503214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068adb-f034-417e-b857-db27e57b0161 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:01.508415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:01.509064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:01.509341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:01.509643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] PATH_INFO: `/v3/users/ff1201dc828b4f2dad98fe7e91e67770` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:01.510753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1201dc828b4f2dad98fe7e91e67770)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:01.512841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:01.684858 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1201dc828b4f2dad98fe7e91e67770'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:01.685583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1201dc828b4f2dad98fe7e91e67770'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:01.697461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1201dc828b4f2dad98fe7e91e67770'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:01.773326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1201dc828b4f2dad98fe7e91e67770'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:01.781641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1201dc828b4f2dad98fe7e91e67770'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:01.788489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1017/2032] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:01 2022] DELETE /identity/v3/users/ff1201dc828b4f2dad98fe7e91e67770 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:01.793128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:01.793656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:01.793755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:01.813371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:01.814732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:01.876002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1016/2033] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:01.885832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:01.887288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:01.944974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe598-237f-4b91-aa64-f059607becc3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:01.948511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:01.951779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:01.951779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:01.951779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:01.958485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:01.960414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:01.969997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1018/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:02.375541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:02.377206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:02.402913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343ca28-cc0c-4395-9b85-1782712a0337 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:02.409774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:02.410496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:02.410842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:02.411170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] PATH_INFO: `/v3/projects/de1ac6d8840542b9ba7a4fb3eb1dfff8` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:02.412497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1ac6d8840542b9ba7a4fb3eb1dfff8)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:02.414537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:02.512192 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1ac6d8840542b9ba7a4fb3eb1dfff8', 'request_id': 'req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.518954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1ac6d8840542b9ba7a4fb3eb1dfff8', 'request_id': 'req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.564922 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:02.566516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:02.580032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0bc8c-4496-437d-a60f-a76a5d021a2d service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:02.617055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1ac6d8840542b9ba7a4fb3eb1dfff8', 'request_id': 'req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.628439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:02.632805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] The token cache is being invalidate because project de1ac6d8840542b9ba7a4fb3eb1dfff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:02.633091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.633778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.635295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1017/2035] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:02 2022] DELETE /identity/v3/projects/de1ac6d8840542b9ba7a4fb3eb1dfff8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:46:02.639188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:02.640230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:02.640869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:02.641165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:02.641459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] PATH_INFO: `/v3/users/a972f1b3086548a28279d52670296f32` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:02.642747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a972f1b3086548a28279d52670296f32)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:02.644670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:02.646396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:02.662251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7f30-daec-4a36-aaa6-595ca2f419a0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:02.668299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:02.668954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:02.669232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:02.669693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] PATH_INFO: `/v3/users/7dda1101562540acb5496903cfe05dc0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:02.670936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dda1101562540acb5496903cfe05dc0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:02.673842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:02.690819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:02.848954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a972f1b3086548a28279d52670296f32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.848954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a972f1b3086548a28279d52670296f32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.863549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a972f1b3086548a28279d52670296f32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.918476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dda1101562540acb5496903cfe05dc0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.919356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dda1101562540acb5496903cfe05dc0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.935317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dda1101562540acb5496903cfe05dc0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.943903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dda1101562540acb5496903cfe05dc0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.945334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dda1101562540acb5496903cfe05dc0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.949406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a972f1b3086548a28279d52670296f32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.958976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d17f6f50-7546-4b90-bf90-3b0dcca5f85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a972f1b3086548a28279d52670296f32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:02.965860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1019/2036] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:02 2022] DELETE /identity/v3/users/a972f1b3086548a28279d52670296f32 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:02.976822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:02.977114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:02.977393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:03.005941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:03.007007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:03.070310 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1018/2037] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:02 2022] DELETE /identity/v3/users/7dda1101562540acb5496903cfe05dc0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:46:03.101132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1020/2038] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:46:03.112642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:03.115803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:03.207289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b63b5-ce95-4038-b71c-454e493b1092 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:03.210938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:03.211550 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:03.211887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:03.212092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:03.274994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:03.276478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:03.287000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1019/2039] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:03.683773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:03.685977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:03.703960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe5415-68be-4f39-ad44-fb48bcc2e16a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:03.709249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:03.710852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:03.711233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:03.711577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] PATH_INFO: `/v3/projects/54dc3ceeb3084ed19db6f9ffbfa34aeb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:03.712891 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dc3ceeb3084ed19db6f9ffbfa34aeb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:03.715524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:03.765854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:03.768054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:03.786988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4cac-c6cb-4151-9848-f165c7c6353e service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:03.794067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:03.795137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:03.795568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:03.796001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] PATH_INFO: `/v3/projects/a1f75d1b0bd043808176160925a03289` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:03.797626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f75d1b0bd043808176160925a03289)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:03.799797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:03.855184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dc3ceeb3084ed19db6f9ffbfa34aeb', 'request_id': 'req-0d242855-a2ee-46d9-b74f-ac9422a4db36'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.861526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dc3ceeb3084ed19db6f9ffbfa34aeb', 'request_id': 'req-0d242855-a2ee-46d9-b74f-ac9422a4db36'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.917669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:03.931797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f75d1b0bd043808176160925a03289', 'request_id': 'req-80499605-d385-43f4-b127-113a0e6469ac'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.934349 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dc3ceeb3084ed19db6f9ffbfa34aeb', 'request_id': 'req-0d242855-a2ee-46d9-b74f-ac9422a4db36'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.940299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:03.941152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f75d1b0bd043808176160925a03289', 'request_id': 'req-80499605-d385-43f4-b127-113a0e6469ac'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.949066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] The token cache is being invalidate because project 54dc3ceeb3084ed19db6f9ffbfa34aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:03.949360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.950196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:03.951908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1021/2040] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:03 2022] DELETE /identity/v3/projects/54dc3ceeb3084ed19db6f9ffbfa34aeb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:03.955963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:03.958124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:04.022122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d242855-a2ee-46d9-b74f-ac9422a4db36 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:04.031355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f75d1b0bd043808176160925a03289', 'request_id': 'req-80499605-d385-43f4-b127-113a0e6469ac'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.044830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] The token cache is being invalidate because project a1f75d1b0bd043808176160925a03289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:04.045118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.045843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.047474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1020/2041] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:03 2022] DELETE /identity/v3/projects/a1f75d1b0bd043808176160925a03289 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:46:04.082126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:04.082791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:04.083071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:04.083383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] PATH_INFO: `/v3/users/cd808f35074d424fbd2a80284598c40b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:04.084676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd808f35074d424fbd2a80284598c40b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:04.087223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:04.306189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd808f35074d424fbd2a80284598c40b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.307470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd808f35074d424fbd2a80284598c40b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.322716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd808f35074d424fbd2a80284598c40b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.399275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd808f35074d424fbd2a80284598c40b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.406793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f63dccc4-28f8-47c5-8347-13aa39ee5386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd808f35074d424fbd2a80284598c40b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:04.412839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1022/2042] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:03 2022] DELETE /identity/v3/users/cd808f35074d424fbd2a80284598c40b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:46:04.803241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:04.805205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:04.820580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80499605-d385-43f4-b127-113a0e6469ac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:04.894393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:04.895094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:04.895717 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:04.895992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] PATH_INFO: `/v3/projects/fba0933f6ec841998ab589ec29f168f5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:04.897150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba0933f6ec841998ab589ec29f168f5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:04.899084 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:05.016855 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba0933f6ec841998ab589ec29f168f5', 'request_id': 'req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:05.023108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba0933f6ec841998ab589ec29f168f5', 'request_id': 'req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:05.116879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba0933f6ec841998ab589ec29f168f5', 'request_id': 'req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:05.128098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] The token cache is being invalidate because project fba0933f6ec841998ab589ec29f168f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:05.128389 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:05.129013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:05.130537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1021/2043] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:04 2022] DELETE /identity/v3/projects/fba0933f6ec841998ab589ec29f168f5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:05.476787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b981-65c9-4817-a061-624c89e81d5e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:05.477636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b981-65c9-4817-a061-624c89e81d5e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:05.477939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b981-65c9-4817-a061-624c89e81d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:05.499631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3828b981-65c9-4817-a061-624c89e81d5e None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:05.500808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3828b981-65c9-4817-a061-624c89e81d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:05.515535 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:05.558655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1023/2044] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:46:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:05.599729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:05.601770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:05.652780 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:05.670449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd9b-67f6-4619-a8a8-8d46628d1ea3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:05.675433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:05.676031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:05.676339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:05.676614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:05.684597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:05.686202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:05.694147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1022/2045] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:46:15.669888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=16 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:15.776081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=9 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:29.269533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767da151-9f03-4874-9e06-17a849c18820 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:29.270004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767da151-9f03-4874-9e06-17a849c18820 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:29.270111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767da151-9f03-4874-9e06-17a849c18820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:29.289482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-767da151-9f03-4874-9e06-17a849c18820 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:29.290740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-767da151-9f03-4874-9e06-17a849c18820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:29.297869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1024/2046] 10.222.0.26 () {58 vars in 967 bytes} [Wed Nov 2 07:46:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:29.310335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:29.320734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb8b3-a0d7-4fcc-85a1-606aaf53f976 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:29.326301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:29.326892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:29.327173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:29.327449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:29.335340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:29.337556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:29.345766 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1023/2047] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:46:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:46:32.515043 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767da151-9f03-4874-9e06-17a849c18820 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:32.516603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-767da151-9f03-4874-9e06-17a849c18820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:32.584065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767da151-9f03-4874-9e06-17a849c18820 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:32.588938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:32.589638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:32.589906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:32.590175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] PATH_INFO: `/v3/users/3d7238669a7c4367872b92e5084d5422` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:32.591389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7238669a7c4367872b92e5084d5422)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:32.593339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:32.768778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7238669a7c4367872b92e5084d5422'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:32.769396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7238669a7c4367872b92e5084d5422'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:32.781085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7238669a7c4367872b92e5084d5422'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:32.862639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7238669a7c4367872b92e5084d5422'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:32.870485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-681366cf-f5b5-49b2-b73b-12ff527f54fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7238669a7c4367872b92e5084d5422'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:32.876275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1025/2048] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:32 2022] DELETE /identity/v3/users/3d7238669a7c4367872b92e5084d5422 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:33.115598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.127101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab70f-e91a-41e4-9543-5ebe6f7d9ba2 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.184570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.187660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.187660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.187660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] PATH_INFO: `/v3/projects/d93d4546741c4135b52082f8d0fdfc4c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.187660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93d4546741c4135b52082f8d0fdfc4c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.189136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:33.300825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93d4546741c4135b52082f8d0fdfc4c', 'request_id': 'req-be865ba4-e268-4786-8d6f-bb92c8b17f7e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:33.307123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93d4546741c4135b52082f8d0fdfc4c', 'request_id': 'req-be865ba4-e268-4786-8d6f-bb92c8b17f7e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:33.380014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93d4546741c4135b52082f8d0fdfc4c', 'request_id': 'req-be865ba4-e268-4786-8d6f-bb92c8b17f7e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:33.391640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] The token cache is being invalidate because project d93d4546741c4135b52082f8d0fdfc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:33.396344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:33.396344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-be865ba4-e268-4786-8d6f-bb92c8b17f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:33.396344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1024/2049] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:33 2022] DELETE /identity/v3/projects/d93d4546741c4135b52082f8d0fdfc4c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:46:33.400473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.400782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.401053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.420644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:33.421868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:33.479371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1026/2050] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:33.487749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.488073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.488363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.507760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:33.508944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:33.516765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1025/2051] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:33.520904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.531124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aca26-8bc0-4d0d-892e-02bb2e38e88f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.537045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.537045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.537045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.537045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.537374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:46:33.537617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.539191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:33.548246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:33.551421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1027/2052] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:46:33.555653 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.564779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c7f7b-d8dc-4fb0-a3cb-a8bfb44d3b38 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.569769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.570349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.570623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.570891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.572032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.574052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:33.672374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1026/2053] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:46:33 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:46:33.676486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.686209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0a0e4-1d80-4a82-be23-7a6d1c93e8de admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.742840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.743443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.744247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.744247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.744611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.746548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:33.811268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1028/2054] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:46:33 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:46:33.815326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.826654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7977d-fb8f-4940-a2fb-160a4ac84621 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.831403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.831999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.832275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.832643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.833281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.834889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:33.845899 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1027/2055] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:33.850091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.860258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e10584-4bbb-4613-a4d8-49258393adcd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.865280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03cb42-0a8f-440d-9885-2de3158b26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.865933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03cb42-0a8f-440d-9885-2de3158b26a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.866224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03cb42-0a8f-440d-9885-2de3158b26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.866483 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03cb42-0a8f-440d-9885-2de3158b26a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.867127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03cb42-0a8f-440d-9885-2de3158b26a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.868765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03cb42-0a8f-440d-9885-2de3158b26a5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:33.879790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1029/2056] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:33.884476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:33.894644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470275fe-7e55-48d0-8c2c-ab3848c9a0ec admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:33.899267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:33.900503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:33.900781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:33.901053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] PATH_INFO: `/v3/projects/fcc26adcb6794673b55ae872e7f2f780/users/da00fba9f8c448bea30684d5736eb8bd/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:33.915318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc26adcb6794673b55ae872e7f2f780, user_id=da00fba9f8c448bea30684d5736eb8bd, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:33.918024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:34.004837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1028/2057] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:46:33 2022] PUT /identity/v3/projects/fcc26adcb6794673b55ae872e7f2f780/users/da00fba9f8c448bea30684d5736eb8bd/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:34.010339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b52afe-e20d-46b1-a1af-aa664734be4e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:34.010623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b52afe-e20d-46b1-a1af-aa664734be4e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:34.010899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b52afe-e20d-46b1-a1af-aa664734be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:34.029688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e1b52afe-e20d-46b1-a1af-aa664734be4e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:34.030870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e1b52afe-e20d-46b1-a1af-aa664734be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:34.087437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1030/2058] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:34.097223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:34.098929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:34.112866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:34.156312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe514-63da-4d3c-a1a6-1b1bf7a74d67 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:34.159945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:34.160565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:34.160878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:34.161121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:34.169961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:34.171369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:34.181413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1029/2059] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:37.080058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571946-cc88-4fc8-9f1e-607a53a222e1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:37.081104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571946-cc88-4fc8-9f1e-607a53a222e1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:37.081104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571946-cc88-4fc8-9f1e-607a53a222e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:37.101984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6c571946-cc88-4fc8-9f1e-607a53a222e1 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:37.103286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6c571946-cc88-4fc8-9f1e-607a53a222e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:37.166571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1031/2060] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:46:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:37.179889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:37.182365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:37.262936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2b0b7-48e8-4b84-b8bb-944646629926 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:37.268840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:37.269576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:37.269861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:37.270268 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:37.280570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:37.282247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:37.291368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1030/2061] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:46:40.169210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:40.169210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:40.169210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:40.251884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] MFA Rules not processed for user `da00fba9f8c448bea30684d5736eb8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:40.254376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:40.284103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:40.384925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1032/2062] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:40.386456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:40.404822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9031-c158-48ac-988e-a7d447b6d520 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:40.412819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:40.414116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:40.415159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:40.415651 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:40.416623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:40.418861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:40.569236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1031/2063] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:46:40 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:46:40.569474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:40.581276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66e9ab-74d7-4365-ae67-afb02b55fe7e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:40.652505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:40.653284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:40.653656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:40.654002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:40.654720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:40.661165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:40.754346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1033/2064] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:46:40 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:46:40.755928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:40.786724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc136-7206-47ca-9cd9-8d99e90dc8b7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:40.792176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:40.792896 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:40.793383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:40.793579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:40.798652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:40.798652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:40.808866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1032/2065] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:40.813034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:40.828860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bf98-c3bf-4e89-b3e9-64167d00426f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:40.838427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:40.839667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:40.845232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:40.845929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] PATH_INFO: `/v3/projects/ecb94b1c5d324db3b1a79f6533544a1e/users/0bcabba418944533af516a93b5da6b67/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:40.873422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb94b1c5d324db3b1a79f6533544a1e, user_id=0bcabba418944533af516a93b5da6b67, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:40.876559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:40.957481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1034/2066] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:46:40 2022] PUT /identity/v3/projects/ecb94b1c5d324db3b1a79f6533544a1e/users/0bcabba418944533af516a93b5da6b67/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:40.961628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:40.974116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a4c5-1813-4149-a13c-8188e4551a15 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:41.092726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90f9c7-727d-4a2a-9907-e0efb67f1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:41.093639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f9c7-727d-4a2a-9907-e0efb67f1fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:41.093999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f9c7-727d-4a2a-9907-e0efb67f1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:41.094335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f9c7-727d-4a2a-9907-e0efb67f1fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:41.095126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f9c7-727d-4a2a-9907-e0efb67f1fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:41.097086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f9c7-727d-4a2a-9907-e0efb67f1fa1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:41.110345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1033/2067] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:41.114406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:41.127516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d9a72-1f89-4cb0-afda-9d77a96485dc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:41.134233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:41.134962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:41.137770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:41.138055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] PATH_INFO: `/v3/projects/ecb94b1c5d324db3b1a79f6533544a1e/users/0bcabba418944533af516a93b5da6b67/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:41.141235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb94b1c5d324db3b1a79f6533544a1e, user_id=0bcabba418944533af516a93b5da6b67, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:41.144565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:41.159635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1035/2068] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:46:41 2022] PUT /identity/v3/projects/ecb94b1c5d324db3b1a79f6533544a1e/users/0bcabba418944533af516a93b5da6b67/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:45.823163 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8925-90e1-43df-8e2b-1c36f97594fc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:45.824002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8925-90e1-43df-8e2b-1c36f97594fc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:45.828041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8925-90e1-43df-8e2b-1c36f97594fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:45.862702 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e3fd8925-90e1-43df-8e2b-1c36f97594fc None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:45.866357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e3fd8925-90e1-43df-8e2b-1c36f97594fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:45.883396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:46.044996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1034/2069] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:46.072934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:46.076459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:46.252680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:46.259193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930945f-f8d3-4bd2-84b3-d6efc4622989 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:46.280888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:46.283013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:46.283295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:46.283553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:46.301198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:46.310222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:46.328268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1036/2070] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:49.068923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169d62-6680-4970-a3a8-228e3250daca None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:49.069523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169d62-6680-4970-a3a8-228e3250daca None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:49.069523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169d62-6680-4970-a3a8-228e3250daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:49.105800 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bc169d62-6680-4970-a3a8-228e3250daca None None] MFA Rules not processed for user `0bcabba418944533af516a93b5da6b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:49.107134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc169d62-6680-4970-a3a8-228e3250daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:49.207148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1035/2071] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:46:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:49.237455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:49.238939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:49.316943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c37668-da21-4128-b8ed-dcf828dfecca service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:49.321849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:49.322686 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:49.323465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:49.324144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:49.392379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:49.394113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:49.404071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1037/2072] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:49.738615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d672-5532-42fa-9ad3-9f9f5bcc4016 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:49.739887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d672-5532-42fa-9ad3-9f9f5bcc4016 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:49.740324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d672-5532-42fa-9ad3-9f9f5bcc4016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:49.770437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4795d672-5532-42fa-9ad3-9f9f5bcc4016 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:49.771649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4795d672-5532-42fa-9ad3-9f9f5bcc4016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:49.843657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1036/2073] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:46:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:46:49.858992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:49.939626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee709af-0687-44ef-991d-c360cf907eab service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:49.947990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:49.949753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:49.949753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:49.949753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:49.958101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:49.959670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:49.969285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1038/2074] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:46:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:46:51.939701 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5304-fd26-476e-96a5-1456145a38c4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:51.940768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5304-fd26-476e-96a5-1456145a38c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:51.941239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d5304-fd26-476e-96a5-1456145a38c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:51.971748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-240d5304-fd26-476e-96a5-1456145a38c4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:51.972956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-240d5304-fd26-476e-96a5-1456145a38c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:51.987446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1037/2075] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:52.008138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:52.011049 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:52.030553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d883c74-c863-4354-ae19-4915e6d9e125 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:52.039552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:52.039552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:52.039552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:52.039552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:52.061720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:52.065237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:52.075676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1039/2076] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:57.481632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:57.482216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:57.482216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:57.509346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:57.510609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:57.519003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1038/2077] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:57.540589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:57.552541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8482-6fed-4242-8751-fd5289c5b851 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:57.558722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b379a-032c-488b-89ba-fea19406f853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:57.559322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b379a-032c-488b-89ba-fea19406f853 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:57.559808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b379a-032c-488b-89ba-fea19406f853 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:57.560265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b379a-032c-488b-89ba-fea19406f853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:57.571702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b379a-032c-488b-89ba-fea19406f853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:57.573275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b379a-032c-488b-89ba-fea19406f853 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:57.585399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1040/2078] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:58.948572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:58.950201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:58.989968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:59.036463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceee1d-fde3-400f-bfcd-6b8f6716de70 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:59.042517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:59.043348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:59.043798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:59.044387 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:59.046158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:59.059254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:59.060840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620939-cafb-42d8-bb68-ad1e69cdc48d service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:59.073091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1039/2079] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:01.686373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:01.687008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:01.687008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:01.706589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] MFA Rules not processed for user `da00fba9f8c448bea30684d5736eb8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:01.707687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:01.715030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1041/2080] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:47:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:02.104364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb894e30-8d15-4803-8e36-31dfd5a6aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.104901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb894e30-8d15-4803-8e36-31dfd5a6aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.104901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb894e30-8d15-4803-8e36-31dfd5a6aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.125954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eb894e30-8d15-4803-8e36-31dfd5a6aaa7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:02.127142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb894e30-8d15-4803-8e36-31dfd5a6aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:02.136301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1040/2081] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:02.340278 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:02.348227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:02.355340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd8c54-6713-4726-876c-9eb59f881c7a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:02.361295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b581c2-4326-4be9-b464-29f896590f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:02.361696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b581c2-4326-4be9-b464-29f896590f95 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.361979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b581c2-4326-4be9-b464-29f896590f95 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.362253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b581c2-4326-4be9-b464-29f896590f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.371347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b581c2-4326-4be9-b464-29f896590f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:02.372911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b581c2-4326-4be9-b464-29f896590f95 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:02.383394 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1042/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:02.660676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b497ff-eeb9-4355-8b3b-58dc8fc7a0b9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.661305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b497ff-eeb9-4355-8b3b-58dc8fc7a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.661609 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b497ff-eeb9-4355-8b3b-58dc8fc7a0b9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.663661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1041/2083] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:47:02.669522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915984d-eec7-4c7c-b8a0-e567cdc7fa2a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.669844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915984d-eec7-4c7c-b8a0-e567cdc7fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.670202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915984d-eec7-4c7c-b8a0-e567cdc7fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.690358 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6915984d-eec7-4c7c-b8a0-e567cdc7fa2a None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:02.691614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6915984d-eec7-4c7c-b8a0-e567cdc7fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:02.701088 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1043/2084] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:47:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:47:02.713302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b497ff-eeb9-4355-8b3b-58dc8fc7a0b9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:02.714979 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13b497ff-eeb9-4355-8b3b-58dc8fc7a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:02.728565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b497ff-eeb9-4355-8b3b-58dc8fc7a0b9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:02.732174 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa144-4125-422b-b6c0-9683e6a23ea2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d3201a663964573be66ab4ad0d13b8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:02.732760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa144-4125-422b-b6c0-9683e6a23ea2 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.733038 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa144-4125-422b-b6c0-9683e6a23ea2 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.733315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa144-4125-422b-b6c0-9683e6a23ea2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.744066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa144-4125-422b-b6c0-9683e6a23ea2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:02.745641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa144-4125-422b-b6c0-9683e6a23ea2 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:02.756546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1042/2085] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:03.011160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b43da3-3b45-4a7c-a185-f1c608c682b8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.011447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b43da3-3b45-4a7c-a185-f1c608c682b8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.011724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b43da3-3b45-4a7c-a185-f1c608c682b8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.013072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1044/2086] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:47:03.017764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17828831-e5a6-45ce-a19f-0988af141c58 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.018048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17828831-e5a6-45ce-a19f-0988af141c58 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.018318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17828831-e5a6-45ce-a19f-0988af141c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.038392 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-17828831-e5a6-45ce-a19f-0988af141c58 None None] MFA Rules not processed for user `94d217e156e944c3ba7dbbab90344e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:03.039588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-17828831-e5a6-45ce-a19f-0988af141c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.093456 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1043/2087] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:03.105779 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b43da3-3b45-4a7c-a185-f1c608c682b8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.107473 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9b43da3-3b45-4a7c-a185-f1c608c682b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.120426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b43da3-3b45-4a7c-a185-f1c608c682b8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.124182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1043bda-d9ad-4bec-8c9b-991b3d93800c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.124803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1043bda-d9ad-4bec-8c9b-991b3d93800c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.125410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1043bda-d9ad-4bec-8c9b-991b3d93800c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.125410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1043bda-d9ad-4bec-8c9b-991b3d93800c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.133626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1043bda-d9ad-4bec-8c9b-991b3d93800c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.135013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1043bda-d9ad-4bec-8c9b-991b3d93800c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.143541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1045/2088] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:03.235503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2528-46b3-469e-b39a-44153ab314d6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.235919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2528-46b3-469e-b39a-44153ab314d6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.236070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2528-46b3-469e-b39a-44153ab314d6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.237591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1044/2089] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:47:03.243902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4f951-04fa-41eb-ab00-ee04e97ebf28 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.244218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4f951-04fa-41eb-ab00-ee04e97ebf28 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.244493 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4f951-04fa-41eb-ab00-ee04e97ebf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.265980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4ed4f951-04fa-41eb-ab00-ee04e97ebf28 None None] MFA Rules not processed for user `0297ece9087142c1987312d97a6a3867`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:03.267167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4ed4f951-04fa-41eb-ab00-ee04e97ebf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.276951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1046/2090] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:47:03.287548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2528-46b3-469e-b39a-44153ab314d6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.298921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2528-46b3-469e-b39a-44153ab314d6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.302521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.304877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.305145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.305418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.315657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.317073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.328356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1045/2091] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:06.419439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4379-5e37-4384-9afa-4be66adfb200 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:06.419932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4379-5e37-4384-9afa-4be66adfb200 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:06.420116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4379-5e37-4384-9afa-4be66adfb200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:06.440068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dfbd4379-5e37-4384-9afa-4be66adfb200 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:06.441377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dfbd4379-5e37-4384-9afa-4be66adfb200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:06.450191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1047/2092] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:06.471357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:06.482893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d45f1-272a-4037-80cd-47ed457d954d service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:06.488829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:06.489427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:06.489762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:06.490021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:06.499157 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:06.500749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:06.511255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1046/2093] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:07.630299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb24b1-2bca-4f81-b049-d54832f9f953 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:07.630752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb24b1-2bca-4f81-b049-d54832f9f953 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:07.630842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb24b1-2bca-4f81-b049-d54832f9f953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:07.651217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-84cb24b1-2bca-4f81-b049-d54832f9f953 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:07.652415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-84cb24b1-2bca-4f81-b049-d54832f9f953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:07.660177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1048/2094] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:47:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:07.683605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:07.695545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7760-93c4-4562-887e-6b9ba95a037a service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:07.700781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:07.701395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:07.701721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:07.702006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:07.711761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:07.713615 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:07.722544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1047/2095] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:47:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:47:17.653589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=23 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:17.718949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=70 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:25.127608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850c376-8b03-4e7d-a5d9-8bac5824dda2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:25.128107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850c376-8b03-4e7d-a5d9-8bac5824dda2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:25.128238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850c376-8b03-4e7d-a5d9-8bac5824dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:25.147050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8850c376-8b03-4e7d-a5d9-8bac5824dda2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:25.148226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8850c376-8b03-4e7d-a5d9-8bac5824dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:25.156797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1049/2096] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:25.179060 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:25.191037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca9f39-1954-4b38-b545-0b0ae30771b8 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:25.196556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:25.197140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:25.197421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:25.197728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:25.206537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:25.208093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:25.218373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1048/2097] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:27.987454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eefdc2-f89c-406a-801a-8973dfb7c180 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:27.987966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eefdc2-f89c-406a-801a-8973dfb7c180 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:27.988064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eefdc2-f89c-406a-801a-8973dfb7c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:28.007734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f4eefdc2-f89c-406a-801a-8973dfb7c180 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:28.008910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f4eefdc2-f89c-406a-801a-8973dfb7c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:28.017089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1050/2098] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:47:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:28.030395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:28.042149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c106-adaf-43a2-abf1-8f0540ca9b22 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:28.047644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:28.048367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:28.048658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:28.048925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:28.057489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:28.059820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:28.069111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1049/2099] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:47:38.002037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:38.065454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=12 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:53.426629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:53.427224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:53.427224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:53.446598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:53.447782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:53.455592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1051/2100] 10.222.0.26 () {58 vars in 967 bytes} [Wed Nov 2 07:47:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:53.468156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:53.478931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2779a4-7139-4a52-9247-6e0e2c835118 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:53.491963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e3af3-5a27-40b6-9d53-26e62a574502 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:53.491963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3af3-5a27-40b6-9d53-26e62a574502 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:53.491963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3af3-5a27-40b6-9d53-26e62a574502 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:53.491963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3af3-5a27-40b6-9d53-26e62a574502 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:53.497623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3af3-5a27-40b6-9d53-26e62a574502 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:53.499512 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3af3-5a27-40b6-9d53-26e62a574502 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:53.508862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1050/2101] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:47:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:48:02.435206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:02.445570 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25553bd-b77f-4d43-b934-21a3843baef3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:02.452155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c546e3b-f531-41ae-9c9f-0fce328ef0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:02.452855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546e3b-f531-41ae-9c9f-0fce328ef0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:02.453169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546e3b-f531-41ae-9c9f-0fce328ef0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:02.453700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c546e3b-f531-41ae-9c9f-0fce328ef0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:02.475567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c546e3b-f531-41ae-9c9f-0fce328ef0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:02.477133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c546e3b-f531-41ae-9c9f-0fce328ef0a2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:02.487920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1052/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:03.505291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:08.538215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.538851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.538851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.559643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] MFA Rules not processed for user `04e43bb9ba8f42d99bf1760a82b1eec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:08.560874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.624113 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1051/2103] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:48:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:10.326616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db251b1-b918-442e-808b-23218a20de4a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.327258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db251b1-b918-442e-808b-23218a20de4a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.327258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db251b1-b918-442e-808b-23218a20de4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.346519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8db251b1-b918-442e-808b-23218a20de4a None None] MFA Rules not processed for user `429fa7f2640a4b8d9e9ad48002bf2425`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:10.348316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8db251b1-b918-442e-808b-23218a20de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:10.401435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1053/2104] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:18.617290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=25 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:19.309889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:19.319648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ce59-0ca0-49b3-a92e-7620560eba89 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:19.323313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:19.323909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:19.324491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:19.324597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:19.326386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:19.341101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:19.342553 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf668c-ffa0-4201-a361-cb211c764e2f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:19.354978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1052/2105] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:20.394408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=34 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:20.492800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db251b1-b918-442e-808b-23218a20de4a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:20.508633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db251b1-b918-442e-808b-23218a20de4a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:20.514074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:20.514701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:20.515626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:20.515918 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:20.518623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:20.538815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:20.540808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:20.555495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1054/2106] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:29.350130 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:30.549216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:31.673282 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b648d-7777-4c01-91f3-1eb38b4315e7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.673857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b648d-7777-4c01-91f3-1eb38b4315e7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.673857 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b648d-7777-4c01-91f3-1eb38b4315e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.693842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cd9b648d-7777-4c01-91f3-1eb38b4315e7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:31.695037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd9b648d-7777-4c01-91f3-1eb38b4315e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:31.702736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1053/2107] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:31.728596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.739448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea1d8d-ebf2-429f-af54-36bb5714461a service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:31.745441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:31.746052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:31.746328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:31.746594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:31.754979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:31.756547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:31.765921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1055/2108] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:36.074347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebdd6-7927-4a8f-b633-d3ee73f1d815 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:36.074783 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebdd6-7927-4a8f-b633-d3ee73f1d815 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:36.074947 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebdd6-7927-4a8f-b633-d3ee73f1d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:36.094617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3c8ebdd6-7927-4a8f-b633-d3ee73f1d815 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:36.095704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3c8ebdd6-7927-4a8f-b633-d3ee73f1d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:36.104494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1054/2109] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:36.130905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:36.142599 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4449d-c5f4-49d0-8f67-8593a7758cf9 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:36.148015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:36.148610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:36.148890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:36.149164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:36.158685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:36.160243 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:36.169563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1056/2110] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:40.084218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ef54-4a00-4d11-ac19-b840e505d753 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:40.084718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ef54-4a00-4d11-ac19-b840e505d753 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:40.084822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ef54-4a00-4d11-ac19-b840e505d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:40.106127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fc43ef54-4a00-4d11-ac19-b840e505d753 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:40.107312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fc43ef54-4a00-4d11-ac19-b840e505d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:40.115035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1055/2111] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:40.138787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:40.149639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee97d2-2fd7-45ff-9b3d-d329282b7455 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:40.155522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:40.156109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:40.156387 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:40.156658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:40.164546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:40.166750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:40.175952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1057/2112] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:44.352988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08e2f-1dc9-4cf5-9a0e-0844d05c77aa None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:44.353489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08e2f-1dc9-4cf5-9a0e-0844d05c77aa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:44.353643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08e2f-1dc9-4cf5-9a0e-0844d05c77aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:44.373682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b0b08e2f-1dc9-4cf5-9a0e-0844d05c77aa None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:44.374906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b0b08e2f-1dc9-4cf5-9a0e-0844d05c77aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:44.382795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1056/2113] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:44.410806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:44.422439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9275c6-debb-465c-af8c-0358d75c070e service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:44.428017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:44.428655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:44.428917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:44.429191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:44.437916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:44.439470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:44.448738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1058/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:49.678740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:49.679249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:49.679351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:49.698867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:49.700050 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:49.707821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1057/2115] 10.222.0.42 () {58 vars in 1016 bytes} [Wed Nov 2 07:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:49.737677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:49.749202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85b49-50a8-4f74-a29b-0f40b02eca05 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:49.754653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:49.755237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:49.755516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:49.755785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:49.763602 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:49.765135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:49.774368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1059/2116] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:59.693636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=15 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:59.770172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=30 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:02.666296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.679491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f18dd-09c9-4973-94e4-a0ebb5d1fd33 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.684872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.685464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.685785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.686053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.688378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:02.700322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.701935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.712856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1058/2117] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:12.055806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:12.067287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e7f8b-517f-4f07-8457-3f781f03e92d service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:12.072851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187be02-5255-491e-b16f-410023676b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:12.073561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187be02-5255-491e-b16f-410023676b6f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.073853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187be02-5255-491e-b16f-410023676b6f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.074123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187be02-5255-491e-b16f-410023676b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.075813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2187be02-5255-491e-b16f-410023676b6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:12.134423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187be02-5255-491e-b16f-410023676b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:12.135996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187be02-5255-491e-b16f-410023676b6f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:12.145796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1060/2118] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:12.708241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:18.530390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:18.541070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587a641-27b5-49ff-9f51-f94b1c9f65ab service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:18.545218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:18.545997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:18.546336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:18.546870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:18.549891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:18.562255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:18.564186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:18.576817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1059/2119] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:22.140786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=28 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:24.202084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.202656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.202656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.224828 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] MFA Rules not processed for user `a881b31e78e7433bb3eab1608884ae1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:24.225978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:24.233020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1061/2120] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:49:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:24.544993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.553622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56ad44-40d2-48d7-a52d-c65f18bfbb51 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.557218 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.557833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.558112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.558384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.560092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:24.569356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.570823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:24.578706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1060/2121] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:24.952944 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:24.965751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876abfc-2c10-4f2f-8c8c-e11b943a3824 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:24.970782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:24.971527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:24.971806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:24.972079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:24.973939 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:24.986632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:24.990921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.001815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1062/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:25.144777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:25.146313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:25.202280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91c37d-d7e6-479a-922f-2d0a27c9c259 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:25.205797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:25.206394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:25.206674 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:25.206945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:25.208658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:25.219391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:25.220815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:25.233737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1061/2123] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:28.521715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:28.524248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:28.540659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fde6be-213e-43c3-8fee-e592a455b3b9 service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:28.545313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537605-dbca-4972-980f-993718874815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:28.546033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537605-dbca-4972-980f-993718874815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:28.546397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537605-dbca-4972-980f-993718874815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:28.546869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537605-dbca-4972-980f-993718874815 admin admin] PATH_INFO: `/v3/users/04e43bb9ba8f42d99bf1760a82b1eec0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:28.548013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0537605-dbca-4972-980f-993718874815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e43bb9ba8f42d99bf1760a82b1eec0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:28.550842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0537605-dbca-4972-980f-993718874815 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:28.717921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e43bb9ba8f42d99bf1760a82b1eec0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.718850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e43bb9ba8f42d99bf1760a82b1eec0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.733924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e43bb9ba8f42d99bf1760a82b1eec0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.789595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e43bb9ba8f42d99bf1760a82b1eec0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.797839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e43bb9ba8f42d99bf1760a82b1eec0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:28.804511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1063/2124] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:28 2022] DELETE /identity/v3/users/04e43bb9ba8f42d99bf1760a82b1eec0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:29.063895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:29.075202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e20d-82b2-4f8b-955a-5b8498772d2e service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:29.133959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:29.134533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:29.134808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:29.135079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] PATH_INFO: `/v3/projects/e9a9412338e142e0b4f5e53b6e1c0fce` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:29.136175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a9412338e142e0b4f5e53b6e1c0fce)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:29.138090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:29.234930 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a9412338e142e0b4f5e53b6e1c0fce', 'request_id': 'req-4b706395-cdc7-49ab-aeda-a051c84ddb3d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.241212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a9412338e142e0b4f5e53b6e1c0fce', 'request_id': 'req-4b706395-cdc7-49ab-aeda-a051c84ddb3d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.319492 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a9412338e142e0b4f5e53b6e1c0fce', 'request_id': 'req-4b706395-cdc7-49ab-aeda-a051c84ddb3d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.329944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] The token cache is being invalidate because project e9a9412338e142e0b4f5e53b6e1c0fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:29.330225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.331435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:29.332887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1062/2125] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:29 2022] DELETE /identity/v3/projects/e9a9412338e142e0b4f5e53b6e1c0fce => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:38.800563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:39.326807 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:40.403028 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:40.403978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:40.485018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537605-dbca-4972-980f-993718874815 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:40.551078 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:40.551688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:40.551996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:40.552265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:40.554053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:40.566762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:40.568837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:40.579547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1064/2126] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:47.869494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:47.874661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.887959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706395-cdc7-49ab-aeda-a051c84ddb3d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:47.900032 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:47.906222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:47.906222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:47.906222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:47.906222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:47.974723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:47.976315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b549c-212c-4e47-94bc-714ecbfe6513 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:47.987045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1063/2127] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:50.575047 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=62 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:54.453762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:54.453762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:54.507046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24984e3c-6f80-4c7b-8634-fc32f9ecd99c service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:54.510626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:54.511228 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:54.511505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:54.511781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:54.513461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:54.578233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:54.579659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a151d5-8d01-4b0d-9d5f-23aabbaa7daa service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:54.591560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1065/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:57.982180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=28 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:58.215023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e586-8667-44fc-a4c7-33e1269ffd3d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:58.215314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e586-8667-44fc-a4c7-33e1269ffd3d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:58.215590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e586-8667-44fc-a4c7-33e1269ffd3d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:58.216982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1064/2129] 10.222.0.26 () {54 vars in 921 bytes} [Wed Nov 2 07:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:49:58.237711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:58.238133 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:58.238253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:58.257839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] MFA Rules not processed for user `856250812d2b4bcdaa732efe4f7e9fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:58.259056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:58.328636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1066/2130] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Nov 2 07:49:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:58.339716 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e586-8667-44fc-a4c7-33e1269ffd3d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:58.341428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0828e586-8667-44fc-a4c7-33e1269ffd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:58.360809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e586-8667-44fc-a4c7-33e1269ffd3d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:58.374836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:58.376114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:58.377734 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:58.380314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:58.384070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:58.384070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:58.392870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ad53f-34ac-4017-beb1-2c4dbbb1f527 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:58.397568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:58.398927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:58.399297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:58.399661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] PATH_INFO: `/v3/users/429fa7f2640a4b8d9e9ad48002bf2425` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:58.400940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429fa7f2640a4b8d9e9ad48002bf2425)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:58.403913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:58.406378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:58.408056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:58.426250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1065/2131] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:58.600949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:58.606222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429fa7f2640a4b8d9e9ad48002bf2425'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:58.609221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429fa7f2640a4b8d9e9ad48002bf2425'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:58.618813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429fa7f2640a4b8d9e9ad48002bf2425'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:58.688542 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429fa7f2640a4b8d9e9ad48002bf2425'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:58.696754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5823281-7ef2-40eb-ad91-4e02ba863ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429fa7f2640a4b8d9e9ad48002bf2425'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:58.703482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1067/2132] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:58 2022] DELETE /identity/v3/users/429fa7f2640a4b8d9e9ad48002bf2425 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:58.935533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:58.947058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522dae7-be9a-4a5a-9737-a061ce67641e service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.021904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.022593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.022791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.023063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] PATH_INFO: `/v3/projects/f7ca4d5eb68e4e79bc69fcfd13289491` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.024224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ca4d5eb68e4e79bc69fcfd13289491)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.026182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.151894 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ca4d5eb68e4e79bc69fcfd13289491', 'request_id': 'req-9269ed35-e060-46b9-9aa7-77c0c6306a9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:59.158252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ca4d5eb68e4e79bc69fcfd13289491', 'request_id': 'req-9269ed35-e060-46b9-9aa7-77c0c6306a9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:59.219914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ca4d5eb68e4e79bc69fcfd13289491', 'request_id': 'req-9269ed35-e060-46b9-9aa7-77c0c6306a9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:59.233365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] The token cache is being invalidate because project f7ca4d5eb68e4e79bc69fcfd13289491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:59.233687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:59.234328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9269ed35-e060-46b9-9aa7-77c0c6306a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:59.235850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1066/2133] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:58 2022] DELETE /identity/v3/projects/f7ca4d5eb68e4e79bc69fcfd13289491 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:59.240724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.241157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.241261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.261275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:59.262553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:59.319991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1068/2134] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:59.328318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.328680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.328956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.349003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:59.350242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:59.358865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1067/2135] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:59.365976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.375490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8301d-107b-4042-b21d-a682b7377367 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.380031 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.380618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.380900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.381173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.381851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:59.382155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.384254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.395601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1069/2136] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:49:59.409909 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.419266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356d3ce-0752-4ed6-a952-c3245b136a10 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.424067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.424705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.424987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.425260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.425943 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.427825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.524103 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1068/2137] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:59 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:59.528238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.538106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29106b-885b-4320-b9e1-7437703eb90f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.592755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.593345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.593658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.593933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.594554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.596455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.700468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1070/2138] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:59 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:59.704584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.715328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4350ce-d926-4169-ba0b-b3fc5439c4ac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.720145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.720754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.721030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.721305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.721989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.723626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.734114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1069/2139] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:59.738259 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.750252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9ea5a-d99f-40ba-9fd9-a934b4205840 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.754923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a23299-d47c-402f-98d2-9736b4e05519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.755511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23299-d47c-402f-98d2-9736b4e05519 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.755785 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23299-d47c-402f-98d2-9736b4e05519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.756059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23299-d47c-402f-98d2-9736b4e05519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.756685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a23299-d47c-402f-98d2-9736b4e05519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.758896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a23299-d47c-402f-98d2-9736b4e05519 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.769334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1071/2140] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:59.773648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.783721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0845121-460a-4516-a892-220beb738d6e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:59.788322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:59.789483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.789788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.790055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] PATH_INFO: `/v3/projects/6ae461f80ab046fb96b39187eaa27adb/users/79ecf233f8eb4641aa078047841b3b1c/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.804291 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae461f80ab046fb96b39187eaa27adb, user_id=79ecf233f8eb4641aa078047841b3b1c, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:59.807539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:59.876986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1070/2141] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:59 2022] PUT /identity/v3/projects/6ae461f80ab046fb96b39187eaa27adb/users/79ecf233f8eb4641aa078047841b3b1c/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:59.888556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:59.888841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:59.889130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:59.916811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] MFA Rules not processed for user `79ecf233f8eb4641aa078047841b3b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:59.918024 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:59.930312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:59.980917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1072/2142] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:49:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:49:59.991751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:59.994075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:00.008296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:00.050668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa0d1-7d91-4607-8217-8fe33509e96c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:00.054315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df1655-03bb-4987-8360-4bfc68077324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:00.055496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df1655-03bb-4987-8360-4bfc68077324 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:00.055773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df1655-03bb-4987-8360-4bfc68077324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:00.056045 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df1655-03bb-4987-8360-4bfc68077324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:00.064270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df1655-03bb-4987-8360-4bfc68077324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:00.065719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df1655-03bb-4987-8360-4bfc68077324 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:00.074426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1071/2143] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:09.697839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:09.760699 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bee0a-d8e6-46fd-b19a-025d8057d26f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:09.765225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:09.765875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:09.766157 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:09.766430 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] PATH_INFO: `/v3/users/79ecf233f8eb4641aa078047841b3b1c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:09.767577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ecf233f8eb4641aa078047841b3b1c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:09.769501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:09.908632 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ecf233f8eb4641aa078047841b3b1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.909309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ecf233f8eb4641aa078047841b3b1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.922236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ecf233f8eb4641aa078047841b3b1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.980507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ecf233f8eb4641aa078047841b3b1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.987721 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ecf233f8eb4641aa078047841b3b1c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:09.993950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1073/2144] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:09 2022] DELETE /identity/v3/users/79ecf233f8eb4641aa078047841b3b1c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:09.998478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:09.999318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:09.999318 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.018126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:10.019315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.077629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1072/2145] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:10.087372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:10.088784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.123845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:10.145798 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33de5f-770c-4f32-97fc-a2bfe1793af7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:10.149309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342199ac-945d-40f7-9e36-04abb3c8ecb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:10.150012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342199ac-945d-40f7-9e36-04abb3c8ecb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.150540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342199ac-945d-40f7-9e36-04abb3c8ecb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.150986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342199ac-945d-40f7-9e36-04abb3c8ecb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.160519 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342199ac-945d-40f7-9e36-04abb3c8ecb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:10.163586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342199ac-945d-40f7-9e36-04abb3c8ecb2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:10.172012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1074/2146] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:50:10.582828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:10.584257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.597293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4415c5-f959-43f9-b9b2-e67b50b73b38 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:10.601938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:10.602563 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.602841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.603112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] PATH_INFO: `/v3/projects/6ae461f80ab046fb96b39187eaa27adb` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.604501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae461f80ab046fb96b39187eaa27adb)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:10.606531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:10.734460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae461f80ab046fb96b39187eaa27adb', 'request_id': 'req-330448e1-d7b5-4d07-976e-d8b15641a196'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:10.740829 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae461f80ab046fb96b39187eaa27adb', 'request_id': 'req-330448e1-d7b5-4d07-976e-d8b15641a196'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:10.796386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae461f80ab046fb96b39187eaa27adb', 'request_id': 'req-330448e1-d7b5-4d07-976e-d8b15641a196'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:10.806590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] The token cache is being invalidate because project 6ae461f80ab046fb96b39187eaa27adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:10.806874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:10.807559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-330448e1-d7b5-4d07-976e-d8b15641a196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:10.809092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1073/2147] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:10 2022] DELETE /identity/v3/projects/6ae461f80ab046fb96b39187eaa27adb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:10.814231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.814680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.814787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.834169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:10.835347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.892860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1075/2148] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:10.900788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.901068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.901338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.921200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:10.922423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.930195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1074/2149] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:10.934332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:10.944383 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9fec-6230-4c9d-887e-40a42e711d84 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:10.948892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:10.949459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.949762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.950041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.951215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:10.951510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:10.953073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:10.964187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1076/2150] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:50:10.968818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:10.977881 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26691de7-6c57-45d5-b24b-4b552a07cb34 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:10.983428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:10.984006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.984284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.984556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.985183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:10.987108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.072788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1075/2151] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:10 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:11.077029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.090372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706da54-05b6-40be-b59a-ca62b557720b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.141524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.142139 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.142417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.142687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.143311 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.145199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.261328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1077/2152] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:11 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:11.265214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.275493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2a91d-93b9-44a3-83ad-088f560951b0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.280548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.281133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.281412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.281720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.282353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.283935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.289025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:11.293898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1076/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:11.298370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.308701 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ccfdb-3c50-4a65-af79-44eaf71382ee admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.313625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298e1f4-8a3a-4580-be29-bd42229e46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.314313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298e1f4-8a3a-4580-be29-bd42229e46d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.314592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298e1f4-8a3a-4580-be29-bd42229e46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.314865 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298e1f4-8a3a-4580-be29-bd42229e46d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.315527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298e1f4-8a3a-4580-be29-bd42229e46d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.317129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298e1f4-8a3a-4580-be29-bd42229e46d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.328169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1078/2154] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:11.332297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.345719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60c056-7753-4bea-b56f-4e7a389a8ced admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.348005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.348639 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.348921 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.349196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] PATH_INFO: `/v3/projects/2febe38d8e79441988e2a38825054416/users/42e855772db441959ac87b60233e6ccc/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.364211 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2febe38d8e79441988e2a38825054416, user_id=42e855772db441959ac87b60233e6ccc, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.366893 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.460347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1077/2155] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:11 2022] PUT /identity/v3/projects/2febe38d8e79441988e2a38825054416/users/42e855772db441959ac87b60233e6ccc/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:11.471518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.471805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.472077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.499232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] MFA Rules not processed for user `42e855772db441959ac87b60233e6ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:11.500438 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:11.530212 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:11.562211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1079/2156] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:11.566737 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.629217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca65585-5248-4e90-a72c-1f32a759ae67 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.633821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.634418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.634697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.634969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.635591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.637472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.747104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1078/2157] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:11 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:11.751137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.761848 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f969940-6cc6-4019-91f6-2269bad091ac None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.816986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.817616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.817880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.818163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.818786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.820695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.917037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1080/2158] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:11 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:11.921458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.931948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ecfd5-dd7d-46d0-b241-c6767964cf3c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.936850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.937440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.937750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.938024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.938660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.940266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:11.950706 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1079/2159] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:11.954803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:11.964490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd295-c181-4ad4-aa97-4c0a1b0db59b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:11.969531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:11.970187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:11.970467 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:11.970743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] PATH_INFO: `/v3/projects/b5343f98ce164da093055c5b7afa14f1/users/e95759c5413f4b6b94032ab2a29f076c/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:11.985879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5343f98ce164da093055c5b7afa14f1, user_id=e95759c5413f4b6b94032ab2a29f076c, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:11.988541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:12.053877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1081/2160] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:11 2022] PUT /identity/v3/projects/b5343f98ce164da093055c5b7afa14f1/users/e95759c5413f4b6b94032ab2a29f076c/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:12.060019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:12.070090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df06e96-8f74-4ea9-9594-2bec932fef3e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:12.126265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2df463-06da-46f2-b7eb-4c5b4737abec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:12.126872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2df463-06da-46f2-b7eb-4c5b4737abec admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:12.127124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2df463-06da-46f2-b7eb-4c5b4737abec admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:12.127398 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2df463-06da-46f2-b7eb-4c5b4737abec admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:12.128026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2df463-06da-46f2-b7eb-4c5b4737abec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:12.129622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2df463-06da-46f2-b7eb-4c5b4737abec admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:12.139616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1080/2161] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:12.143782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:12.154548 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e939ea-2322-4cdd-b190-bdf46596112b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:12.159234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:12.159870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:12.160147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:12.160418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] PATH_INFO: `/v3/projects/b5343f98ce164da093055c5b7afa14f1/users/e95759c5413f4b6b94032ab2a29f076c/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:12.162386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5343f98ce164da093055c5b7afa14f1, user_id=e95759c5413f4b6b94032ab2a29f076c, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:12.165033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:12.175148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1082/2162] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:12 2022] PUT /identity/v3/projects/b5343f98ce164da093055c5b7afa14f1/users/e95759c5413f4b6b94032ab2a29f076c/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:12.186365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:12.186673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:12.187031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:12.214289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] MFA Rules not processed for user `e95759c5413f4b6b94032ab2a29f076c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:12.215479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:12.249049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:12.283969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1081/2163] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:50:12.294689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:12.296389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:12.354952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e626c-8f0a-41bd-81c2-f8af877be9b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:12.358907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:12.359518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:12.359799 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:12.360074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:12.369148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:12.370592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:12.379997 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1083/2164] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:12.559575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:12.569705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132298-1dbc-4a3c-840d-6bb2aa210b48 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:12.573231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab3f22-69a4-4e93-b21e-add4817b48d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:12.573879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3f22-69a4-4e93-b21e-add4817b48d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:12.574150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3f22-69a4-4e93-b21e-add4817b48d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:12.574407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab3f22-69a4-4e93-b21e-add4817b48d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:12.631308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab3f22-69a4-4e93-b21e-add4817b48d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:12.632734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab3f22-69a4-4e93-b21e-add4817b48d2 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:12.642226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1082/2165] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:21.019392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:21.048425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:21.080709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12227538-c727-46b3-8980-40f66dabea7d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:21.085117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:21.085839 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:21.086113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:21.086382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] PATH_INFO: `/v3/users/42e855772db441959ac87b60233e6ccc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:21.087546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e855772db441959ac87b60233e6ccc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:21.089442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:21.253237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e855772db441959ac87b60233e6ccc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:21.253924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e855772db441959ac87b60233e6ccc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:21.265938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e855772db441959ac87b60233e6ccc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:21.324163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e855772db441959ac87b60233e6ccc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:21.331202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e855772db441959ac87b60233e6ccc'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:21.336981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1084/2166] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:21 2022] DELETE /identity/v3/users/42e855772db441959ac87b60233e6ccc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:21.341827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:21.342319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:21.342431 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:21.361878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:21.363175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:21.420529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1083/2167] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:21.430681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:21.432109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:21.488336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead361-11ea-429d-96e5-062e88ac1b7f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:21.491971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:21.492569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:21.492847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:21.493119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:21.502104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:21.503508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:21.512845 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1085/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:50:21.927767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:21.929344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:21.942624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e58b4-d14e-4837-96f1-2c58c043e3e8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:21.947319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:21.947950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:21.948229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:21.948502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] PATH_INFO: `/v3/projects/2febe38d8e79441988e2a38825054416` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:21.949649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2febe38d8e79441988e2a38825054416)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:21.952274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:22.072654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2febe38d8e79441988e2a38825054416', 'request_id': 'req-8469e1a0-80b8-44bc-8813-b566f625683a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.079532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2febe38d8e79441988e2a38825054416', 'request_id': 'req-8469e1a0-80b8-44bc-8813-b566f625683a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.141191 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2febe38d8e79441988e2a38825054416', 'request_id': 'req-8469e1a0-80b8-44bc-8813-b566f625683a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.145312 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:22.152172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] The token cache is being invalidate because project 2febe38d8e79441988e2a38825054416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:22.157967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.157967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.157967 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1084/2169] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:21 2022] DELETE /identity/v3/projects/2febe38d8e79441988e2a38825054416 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:22.159612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:22.169226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d51af-d44e-4eb1-a90c-1c3cb863e3e2 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:22.213603 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:22.224931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:22.225841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:22.226300 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:22.226628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] PATH_INFO: `/v3/users/e95759c5413f4b6b94032ab2a29f076c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:22.227784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95759c5413f4b6b94032ab2a29f076c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:22.230045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:22.342902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95759c5413f4b6b94032ab2a29f076c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.343587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95759c5413f4b6b94032ab2a29f076c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.355439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95759c5413f4b6b94032ab2a29f076c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.409821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95759c5413f4b6b94032ab2a29f076c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.416730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2537f59c-1200-4095-8b9e-58d369a79cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95759c5413f4b6b94032ab2a29f076c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:22.422524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1086/2170] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:22 2022] DELETE /identity/v3/users/e95759c5413f4b6b94032ab2a29f076c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:22.828536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:22.830111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:22.843270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e1a0-80b8-44bc-8813-b566f625683a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:22.900117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:22.900747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:22.901023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:22.901289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] PATH_INFO: `/v3/projects/b5343f98ce164da093055c5b7afa14f1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:22.902438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5343f98ce164da093055c5b7afa14f1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:22.904329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:22.997872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5343f98ce164da093055c5b7afa14f1', 'request_id': 'req-ccea7641-8d7c-48de-b512-9389711df3e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:23.003997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5343f98ce164da093055c5b7afa14f1', 'request_id': 'req-ccea7641-8d7c-48de-b512-9389711df3e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:23.072344 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5343f98ce164da093055c5b7afa14f1', 'request_id': 'req-ccea7641-8d7c-48de-b512-9389711df3e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:23.082684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] The token cache is being invalidate because project b5343f98ce164da093055c5b7afa14f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:23.082972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:23.083587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccea7641-8d7c-48de-b512-9389711df3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:23.085047 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1085/2171] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:22 2022] DELETE /identity/v3/projects/b5343f98ce164da093055c5b7afa14f1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:23.089960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.090246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.090522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.111353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:23.112547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:23.168850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1087/2172] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:23.177210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.177495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.177794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.197140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:23.198402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:23.206335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1086/2173] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:23.213759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.223802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42739e3b-a665-4cc8-8028-ccf7eaf72140 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.228980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.233952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.233952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.233952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.233952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:23.233952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.233952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.245994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1088/2174] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:50:23.250605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.259814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea998e8-bd2f-493b-b40e-0bcec2e67576 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.264936 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.265614 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.265871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.266139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.266765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.268643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.354479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1087/2175] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:23.359264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.369113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eeb24-557b-447e-ac35-b86c6f89225e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.418207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:23.424914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.425511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.425821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.426113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.426738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.428629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.501616 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1089/2176] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:23.505754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.516618 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106950-296c-4d21-97e8-28a700d2ef03 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.521351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.521980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.522315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.522534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.523176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.524751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.535129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1088/2177] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:23.539057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.548950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b9be-9aca-495e-9d3d-5631e7d9b27d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.553743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbf9d-1c82-4635-b735-05824b44eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.554329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbf9d-1c82-4635-b735-05824b44eadd admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.554600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbf9d-1c82-4635-b735-05824b44eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.554874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbf9d-1c82-4635-b735-05824b44eadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.555552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fbf9d-1c82-4635-b735-05824b44eadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.557147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fbf9d-1c82-4635-b735-05824b44eadd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.567588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1090/2178] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:23.571750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.582010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee9e1-e590-4e70-a161-f935916365df admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.586514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.587231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.587508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.587782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] PATH_INFO: `/v3/projects/22db08020f8c4b61a40038651bbd1913/users/31b72ec3dca44da5a4a13422b0834cfa/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.602759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22db08020f8c4b61a40038651bbd1913, user_id=31b72ec3dca44da5a4a13422b0834cfa, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.605888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.672086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1089/2179] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:23 2022] PUT /identity/v3/projects/22db08020f8c4b61a40038651bbd1913/users/31b72ec3dca44da5a4a13422b0834cfa/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:23.688408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.688689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.688954 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.716229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] MFA Rules not processed for user `31b72ec3dca44da5a4a13422b0834cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:23.717413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:23.781607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1091/2180] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:23.786309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.807368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:23.848776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ece75-3b61-4aac-9576-4e3cbd26bf91 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:23.854094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:23.855566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:23.855566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:23.855566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:23.856239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:23.858125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:23.970984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1090/2181] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:23.974344 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:23.985195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc50a8-5a12-4f59-9985-cffe2e80d9c3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:24.041219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:24.041842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.042121 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.042393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.043020 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:24.044984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:24.123888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1092/2182] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:23 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:24.128504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:24.138858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285541-56e3-49ec-9062-34dc537a736e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:24.143471 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:24.144066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.144349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.144623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.145260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:24.146892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:24.157263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1091/2183] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:24.161180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:24.171001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f921b5-29b3-4792-98e8-6106733e7304 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:24.176025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:24.176657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.176933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.177202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] PATH_INFO: `/v3/projects/5255a089c75c45f2837a2b17786198ff/users/0717f2ab58c54aad9ab43479ea391ffb/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.192363 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255a089c75c45f2837a2b17786198ff, user_id=0717f2ab58c54aad9ab43479ea391ffb, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:24.195070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:24.267274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1093/2184] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:24 2022] PUT /identity/v3/projects/5255a089c75c45f2837a2b17786198ff/users/0717f2ab58c54aad9ab43479ea391ffb/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:24.271159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:24.281132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2b007-84ba-4c65-a461-4f4e605b4b67 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:24.337491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760a7a6-9048-4a1c-80b0-b531fce3eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:24.338126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760a7a6-9048-4a1c-80b0-b531fce3eb2d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.338409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760a7a6-9048-4a1c-80b0-b531fce3eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.338684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760a7a6-9048-4a1c-80b0-b531fce3eb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.339323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760a7a6-9048-4a1c-80b0-b531fce3eb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:24.340916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760a7a6-9048-4a1c-80b0-b531fce3eb2d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:24.350509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1092/2185] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:24.355324 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:24.365963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676050-cf7a-4f26-b2b5-8e20b466a7c2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:24.370529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:24.371174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.371455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.371730 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] PATH_INFO: `/v3/projects/5255a089c75c45f2837a2b17786198ff/users/0717f2ab58c54aad9ab43479ea391ffb/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.373661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255a089c75c45f2837a2b17786198ff, user_id=0717f2ab58c54aad9ab43479ea391ffb, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:24.377053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:24.387128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1094/2186] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:24 2022] PUT /identity/v3/projects/5255a089c75c45f2837a2b17786198ff/users/0717f2ab58c54aad9ab43479ea391ffb/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:24.397235 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.397524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.397833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.427652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] MFA Rules not processed for user `0717f2ab58c54aad9ab43479ea391ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:24.428880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:24.496394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1093/2187] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:24.507868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:24.509591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:24.528844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:24.567489 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4a87c-5e91-49e2-8c45-34fae6d95eb0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:24.571160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:24.571755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:24.572062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:24.572336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:24.629892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:24.631242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:24.640089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1095/2188] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:50:26.407013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:26.415149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:26.420803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3022-8bb0-4a0d-8da8-7282428fc455 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:26.424336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991108c-77d0-4c5d-8628-6ef8a5bbabb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:26.424925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991108c-77d0-4c5d-8628-6ef8a5bbabb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:26.425202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991108c-77d0-4c5d-8628-6ef8a5bbabb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:26.425473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991108c-77d0-4c5d-8628-6ef8a5bbabb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:26.434326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991108c-77d0-4c5d-8628-6ef8a5bbabb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:26.435728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991108c-77d0-4c5d-8628-6ef8a5bbabb6 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:26.444972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1094/2189] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:30.625231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:30.685183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3e05-1019-4ce0-a1e7-17f954a50b34 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:30.689748 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:30.690356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:30.690631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:30.690900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] PATH_INFO: `/v3/users/31b72ec3dca44da5a4a13422b0834cfa` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:30.691990 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b72ec3dca44da5a4a13422b0834cfa)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:30.693962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:30.852395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b72ec3dca44da5a4a13422b0834cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:30.853050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b72ec3dca44da5a4a13422b0834cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:30.865409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b72ec3dca44da5a4a13422b0834cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:30.952766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b72ec3dca44da5a4a13422b0834cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:30.954084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:30.960932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b72ec3dca44da5a4a13422b0834cfa'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:30.966821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1096/2190] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:30 2022] DELETE /identity/v3/users/31b72ec3dca44da5a4a13422b0834cfa => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:30.971945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:30.972420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:30.972526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:30.979544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:30.992015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:30.993472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:31.051411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1095/2191] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:31.060948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:31.062388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:31.118528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f929-8d1e-4497-9b9a-ec30d152208f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:31.122065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:31.122660 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:31.122936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:31.123207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:31.132463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:31.133901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:31.143727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1097/2192] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:50:31.509980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:31.511969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:31.523831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a99df0-4e1b-487d-89ae-fbeca77a61af None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:31.528676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:31.529488 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:31.534866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:31.534866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] PATH_INFO: `/v3/projects/22db08020f8c4b61a40038651bbd1913` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:31.534866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22db08020f8c4b61a40038651bbd1913)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:31.534866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:31.672942 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22db08020f8c4b61a40038651bbd1913', 'request_id': 'req-bc103848-c1c3-4c80-8bd0-cc15602b6146'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:31.679784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22db08020f8c4b61a40038651bbd1913', 'request_id': 'req-bc103848-c1c3-4c80-8bd0-cc15602b6146'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:31.758037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22db08020f8c4b61a40038651bbd1913', 'request_id': 'req-bc103848-c1c3-4c80-8bd0-cc15602b6146'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:31.768597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] The token cache is being invalidate because project 22db08020f8c4b61a40038651bbd1913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:31.768879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:31.769497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:31.770978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1096/2193] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:31 2022] DELETE /identity/v3/projects/22db08020f8c4b61a40038651bbd1913 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:31.775217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:31.784844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff2157-0797-4ebd-b50c-a5123ac22a45 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:31.839947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:31.840565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:31.840841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:31.841112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] PATH_INFO: `/v3/users/0717f2ab58c54aad9ab43479ea391ffb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:31.842236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0717f2ab58c54aad9ab43479ea391ffb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:31.844130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:32.001252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0717f2ab58c54aad9ab43479ea391ffb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.001851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0717f2ab58c54aad9ab43479ea391ffb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.013773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0717f2ab58c54aad9ab43479ea391ffb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.073166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0717f2ab58c54aad9ab43479ea391ffb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.080255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-72d2e3a1-7db0-4615-95dc-b1e5feef7766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0717f2ab58c54aad9ab43479ea391ffb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.086446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1098/2194] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:31 2022] DELETE /identity/v3/users/0717f2ab58c54aad9ab43479ea391ffb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:32.486520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:32.488059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:32.501859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc103848-c1c3-4c80-8bd0-cc15602b6146 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:32.558680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:32.559239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:32.559523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:32.559806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] PATH_INFO: `/v3/projects/5255a089c75c45f2837a2b17786198ff` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:32.560915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5255a089c75c45f2837a2b17786198ff)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:32.562842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:32.635523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:32.650585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5255a089c75c45f2837a2b17786198ff', 'request_id': 'req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.656746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5255a089c75c45f2837a2b17786198ff', 'request_id': 'req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.718247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5255a089c75c45f2837a2b17786198ff', 'request_id': 'req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.729242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] The token cache is being invalidate because project 5255a089c75c45f2837a2b17786198ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:32.729532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.730448 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d6bfe73f-df39-4f1d-b067-ad8d7be9c5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:32.731905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1097/2195] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:32 2022] DELETE /identity/v3/projects/5255a089c75c45f2837a2b17786198ff => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:32.736816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:32.737672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:32.738005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:32.757525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:32.758756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:32.763873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:32.816219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1099/2196] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:32.823814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:32.825059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:32.825059 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:32.843715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:32.844927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:32.853279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1098/2197] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:32.857646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:32.868011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28efe6-5dce-4ef6-950c-256772542c9e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:32.872571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:32.873164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:32.873446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:32.873757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:32.874403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:32.874745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:32.876368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:32.888153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1100/2198] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:50:32.896536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:32.905870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74104c-3f36-4a16-ba93-002e9cbdd961 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:32.910991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:32.911576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:32.911879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:32.912150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:32.912892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:32.914794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:32.993372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1099/2199] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:32 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:33.000495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.010471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e19ac-c8c8-4b8b-aaa5-097bcb711d57 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.067424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.067914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.068194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.068465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.069102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.071048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.157928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1101/2200] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:32 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:33.162779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.173155 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e847-f06f-46b7-b4d6-3fa753482a80 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.177764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.178446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.178729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.178997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.179671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.181286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.191572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1100/2201] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:33.195520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.206325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c12f13-fdd7-4e9c-9288-d3cbc723e08e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.211014 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23de2-09db-4e18-9057-8a456a520e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.211605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23de2-09db-4e18-9057-8a456a520e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.211885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23de2-09db-4e18-9057-8a456a520e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.212156 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23de2-09db-4e18-9057-8a456a520e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.212790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23de2-09db-4e18-9057-8a456a520e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.214460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23de2-09db-4e18-9057-8a456a520e33 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.226348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1102/2202] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:33.230546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.241003 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0014c-325c-45aa-b883-ef7f6549cbbd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.245822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.250402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.250402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.250402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] PATH_INFO: `/v3/projects/4e78a16c74f846128a4821864e66185a/users/2b01a61c606042719b59b96573477e3a/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.261850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e78a16c74f846128a4821864e66185a, user_id=2b01a61c606042719b59b96573477e3a, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.264506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.318216 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1101/2203] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:33 2022] PUT /identity/v3/projects/4e78a16c74f846128a4821864e66185a/users/2b01a61c606042719b59b96573477e3a/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:33.329501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.329829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.330104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.357861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] MFA Rules not processed for user `2b01a61c606042719b59b96573477e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:33.359060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:33.421225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1103/2204] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:33.425758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.486798 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a391db-e217-4424-a90e-cfba1968691b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.491944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.492537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.492813 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.493080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.493771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.495645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.657244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1102/2205] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:33 2022] POST /identity/v3/projects => generated 399 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:33.662001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.672510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ca67-08f2-46c2-94de-290b7d602232 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.676531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:33.729218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.730106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.730455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.730722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.731284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.733195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.799696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1104/2206] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:33 2022] POST /identity/v3/users => generated 306 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:33.803125 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.813433 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead1d8-e507-45ac-9546-c55f2d265136 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.818179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.818769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.819050 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.819322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.819963 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.821610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.832557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1103/2207] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:33.836604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.847092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222b08-7981-437c-b915-cb6f7e86975f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.851614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.852250 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.852526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.852797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] PATH_INFO: `/v3/projects/df4633dfd1734a0ba394331fc1a460e0/users/d8205ff321e641ab82bd3d747ce598ec/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.867531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4633dfd1734a0ba394331fc1a460e0, user_id=d8205ff321e641ab82bd3d747ce598ec, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.870237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:33.918650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1105/2208] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:33 2022] PUT /identity/v3/projects/df4633dfd1734a0ba394331fc1a460e0/users/d8205ff321e641ab82bd3d747ce598ec/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:33.922719 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:33.932633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e771d-ce0d-4d7e-9104-ca2d5c8f06d4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:33.955364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:33.989000 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d5f01-b0a0-450c-aeca-ea4f91b49cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:33.989628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5f01-b0a0-450c-aeca-ea4f91b49cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:33.989903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5f01-b0a0-450c-aeca-ea4f91b49cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:33.990171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d5f01-b0a0-450c-aeca-ea4f91b49cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:33.990819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d5f01-b0a0-450c-aeca-ea4f91b49cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:33.992387 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d5f01-b0a0-450c-aeca-ea4f91b49cf2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:34.001786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1104/2209] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:34.005961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:34.016336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46a334-30ff-4cef-9645-e53c96a155e4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:34.021524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:34.022187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:34.022466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:34.022756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] PATH_INFO: `/v3/projects/df4633dfd1734a0ba394331fc1a460e0/users/d8205ff321e641ab82bd3d747ce598ec/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:34.024672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4633dfd1734a0ba394331fc1a460e0, user_id=d8205ff321e641ab82bd3d747ce598ec, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:34.027526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:34.038141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1106/2210] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:34 2022] PUT /identity/v3/projects/df4633dfd1734a0ba394331fc1a460e0/users/d8205ff321e641ab82bd3d747ce598ec/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:34.048301 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:34.048590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:34.048892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:34.076200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] MFA Rules not processed for user `d8205ff321e641ab82bd3d747ce598ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:34.077375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:34.144449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1105/2211] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:34.155101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:34.156797 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:34.212875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098d6e-49ac-4af2-abf7-a1da32c40c0a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:34.216378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:34.216967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:34.217244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:34.217515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:34.227224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:34.228655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:34.238992 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1107/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:34.452812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:34.463229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35a1e4-5c3a-4672-ae15-2a480aa22661 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:34.466689 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9d12b-bb24-4a19-8024-ffb4defc0dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:34.467278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d12b-bb24-4a19-8024-ffb4defc0dfb service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:34.467547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d12b-bb24-4a19-8024-ffb4defc0dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:34.467811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d12b-bb24-4a19-8024-ffb4defc0dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:34.523491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9d12b-bb24-4a19-8024-ffb4defc0dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:34.524907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9d12b-bb24-4a19-8024-ffb4defc0dfb service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:34.534098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1106/2213] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:39.248723 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:39.308520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705582-b6ee-4553-a960-536a9f409074 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:39.312955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:39.314623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:39.314623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:39.314623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] PATH_INFO: `/v3/users/2b01a61c606042719b59b96573477e3a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:39.315236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b01a61c606042719b59b96573477e3a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:39.317716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:39.319978 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:39.440214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b01a61c606042719b59b96573477e3a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:39.440871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b01a61c606042719b59b96573477e3a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:39.452390 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b01a61c606042719b59b96573477e3a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:39.513496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b01a61c606042719b59b96573477e3a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:39.520691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b01a61c606042719b59b96573477e3a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:39.526597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1108/2214] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:39 2022] DELETE /identity/v3/users/2b01a61c606042719b59b96573477e3a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:39.531296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:39.531739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:39.531859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:39.551765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:39.552993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:39.592482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:39.609649 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1107/2215] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:39.619893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:39.621288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:39.676991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6d09b-5da3-4d38-93de-4f829594b9b5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:39.680587 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:39.681177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:39.681451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:39.681751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:39.690468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:39.691899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:39.701068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1109/2216] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:40.126770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:40.128864 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:40.142862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4da9d-1408-4506-b103-5d1d119a810d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:40.148577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:40.149230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:40.149534 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:40.149804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] PATH_INFO: `/v3/projects/4e78a16c74f846128a4821864e66185a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:40.162625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e78a16c74f846128a4821864e66185a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:40.162625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:40.257862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e78a16c74f846128a4821864e66185a', 'request_id': 'req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.264184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e78a16c74f846128a4821864e66185a', 'request_id': 'req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.353856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e78a16c74f846128a4821864e66185a', 'request_id': 'req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.364820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] The token cache is being invalidate because project 4e78a16c74f846128a4821864e66185a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:40.365104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.365755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.367214 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1108/2217] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:40 2022] DELETE /identity/v3/projects/4e78a16c74f846128a4821864e66185a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:40.371284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:40.381206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5c7a-fb67-4163-a6f4-2ecd2e87e53b service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:40.437249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:40.437906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:40.438181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:40.438451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] PATH_INFO: `/v3/users/d8205ff321e641ab82bd3d747ce598ec` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:40.439604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8205ff321e641ab82bd3d747ce598ec)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:40.441526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:40.536720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:40.624252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8205ff321e641ab82bd3d747ce598ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.624831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8205ff321e641ab82bd3d747ce598ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.636853 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8205ff321e641ab82bd3d747ce598ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.690864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8205ff321e641ab82bd3d747ce598ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.698914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6983e4-bc85-4636-9883-05a68c014b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8205ff321e641ab82bd3d747ce598ec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:40.704808 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1110/2218] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:40 2022] DELETE /identity/v3/users/d8205ff321e641ab82bd3d747ce598ec => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:41.121675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.123365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:41.136903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f8f8-a3b4-4d5e-9df0-fde1951d9d5a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.195759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.196390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.196664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.196931 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] PATH_INFO: `/v3/projects/df4633dfd1734a0ba394331fc1a460e0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.198106 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4633dfd1734a0ba394331fc1a460e0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.200020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.336620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4633dfd1734a0ba394331fc1a460e0', 'request_id': 'req-c38ffcc3-aaa7-4ecf-b244-4384757870e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:41.342940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4633dfd1734a0ba394331fc1a460e0', 'request_id': 'req-c38ffcc3-aaa7-4ecf-b244-4384757870e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:41.403832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4633dfd1734a0ba394331fc1a460e0', 'request_id': 'req-c38ffcc3-aaa7-4ecf-b244-4384757870e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:41.411594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:41.415307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] The token cache is being invalidate because project df4633dfd1734a0ba394331fc1a460e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:41.415594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:41.416302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c38ffcc3-aaa7-4ecf-b244-4384757870e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:41.417804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1109/2219] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:41 2022] DELETE /identity/v3/projects/df4633dfd1734a0ba394331fc1a460e0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:41.423045 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.423520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.423640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.443038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:41.444254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:41.501907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1111/2220] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:41.510638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.510926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.511201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.531076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:41.536712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:41.541030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1110/2221] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:50:41.545145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.554932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9bad2-9e95-42da-a97c-49cf287714c6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.559508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.560091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.560371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.560646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.561292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:41.561626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.563257 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.576980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1112/2222] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:50:41.579763 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.589494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee18d1-3512-4213-b0d3-89ec5c7a11aa None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.594135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.594725 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.595006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.595279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.595916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.597841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.691668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1111/2223] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:41 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:41.696183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.706256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c2b3-c736-437c-bbdb-615b8f84bdda admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.761661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.762190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.762470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.762746 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.763368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.765261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.822672 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1113/2224] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:41 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:41.826746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.837620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45293ea-27c2-4c60-b824-f124c1fd5cda admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.842179 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.842772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.843053 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.843345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.843969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.845588 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.855562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1112/2225] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:41.859498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.869327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ecd48-725d-41d5-9b69-edaebb55be39 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.873910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc6ca-ef9d-465f-8ef9-a775458eca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.874497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc6ca-ef9d-465f-8ef9-a775458eca77 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.874780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc6ca-ef9d-465f-8ef9-a775458eca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.875056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc6ca-ef9d-465f-8ef9-a775458eca77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.875690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc6ca-ef9d-465f-8ef9-a775458eca77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.877263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc6ca-ef9d-465f-8ef9-a775458eca77 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.890393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1114/2226] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:41.892435 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:41.902983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fd0a0-47ee-4da8-a2e2-e1d2f038978e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:41.907585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:41.908224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.908508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.908785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] PATH_INFO: `/v3/projects/2e921ec1355e43a7af021334f8b0979f/users/ff6360710409439ba3b565c1e9e040a2/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:41.923015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e921ec1355e43a7af021334f8b0979f, user_id=ff6360710409439ba3b565c1e9e040a2, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:41.925757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:41.981097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1113/2227] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:41 2022] PUT /identity/v3/projects/2e921ec1355e43a7af021334f8b0979f/users/ff6360710409439ba3b565c1e9e040a2/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:41.991916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:41.992207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:41.992481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.012213 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:42.020824 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] MFA Rules not processed for user `ff6360710409439ba3b565c1e9e040a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:42.022044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:42.084618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1115/2228] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:50:42.089319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.151089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f164e-25e4-482f-9fc1-6356335c5d9c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.155693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.156284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.156557 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.156822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.157454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.159328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.241182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1114/2229] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:42 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:42.245274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.256698 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e27ac-362d-471d-9254-7c8317ae4012 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.312591 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.313114 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.313397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.313703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.314354 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.316255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.399129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1116/2230] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:42 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:42.403043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.413761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867c33-ecbb-4f32-83fc-e0c553c00370 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.418548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.419133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.419408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.419678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.420308 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.421990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.433058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1115/2231] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:42.437058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.447143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9e259-c280-47ff-aa49-6c2e8aefcbdd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.451740 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.452375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.452651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.452924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] PATH_INFO: `/v3/projects/6dcf40f1f34d4efaa034f04726f72739/users/a18d6cdc3e8e432589f7441a7ef9c85a/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.467226 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcf40f1f34d4efaa034f04726f72739, user_id=a18d6cdc3e8e432589f7441a7ef9c85a, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.469909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.548295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1117/2232] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:42 2022] PUT /identity/v3/projects/6dcf40f1f34d4efaa034f04726f72739/users/a18d6cdc3e8e432589f7441a7ef9c85a/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:42.553006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.563247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1a772-948f-4459-986d-df448f1e793a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.618566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f53bb-a1dd-4bf4-af71-e7b414733098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.619159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f53bb-a1dd-4bf4-af71-e7b414733098 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.619434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f53bb-a1dd-4bf4-af71-e7b414733098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.619704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f53bb-a1dd-4bf4-af71-e7b414733098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.620328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f53bb-a1dd-4bf4-af71-e7b414733098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.621946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f53bb-a1dd-4bf4-af71-e7b414733098 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.631307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1116/2233] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:42.635449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.645966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3416bb-89d0-4abb-8c77-e6e06ccc7df4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.650429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.651062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.651339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.651611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] PATH_INFO: `/v3/projects/6dcf40f1f34d4efaa034f04726f72739/users/a18d6cdc3e8e432589f7441a7ef9c85a/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.653483 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcf40f1f34d4efaa034f04726f72739, user_id=a18d6cdc3e8e432589f7441a7ef9c85a, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.656107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.666911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1118/2234] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:42 2022] PUT /identity/v3/projects/6dcf40f1f34d4efaa034f04726f72739/users/a18d6cdc3e8e432589f7441a7ef9c85a/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:42.677112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.677466 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.677778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.691033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:42.705013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] MFA Rules not processed for user `a18d6cdc3e8e432589f7441a7ef9c85a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:42.706229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:42.774189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1117/2235] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:50:42.785110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:42.787291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:42.844117 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d938a3-414d-4a0f-8d74-67ad1f63cc2c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:42.847729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9b2fa-d63a-498e-85a7-bd364bed78e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:42.848326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b2fa-d63a-498e-85a7-bd364bed78e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:42.849195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b2fa-d63a-498e-85a7-bd364bed78e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:42.849468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9b2fa-d63a-498e-85a7-bd364bed78e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:42.855497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:42.859010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b2fa-d63a-498e-85a7-bd364bed78e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:42.860414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9b2fa-d63a-498e-85a7-bd364bed78e4 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:42.869834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1119/2236] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:43.854105 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:43.916333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8241d-0ab1-4c54-9039-1b22dc4afd46 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:43.920825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:43.925484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:43.925484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:43.925484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] PATH_INFO: `/v3/users/ff6360710409439ba3b565c1e9e040a2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:43.925484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6360710409439ba3b565c1e9e040a2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:43.925484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:44.080938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6360710409439ba3b565c1e9e040a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.081599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6360710409439ba3b565c1e9e040a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.093473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6360710409439ba3b565c1e9e040a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.100975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6360710409439ba3b565c1e9e040a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.101654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6360710409439ba3b565c1e9e040a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.175941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1118/2237] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:43 2022] DELETE /identity/v3/users/ff6360710409439ba3b565c1e9e040a2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:44.180378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:44.180832 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:44.180949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:44.199496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:44.200664 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:44.259985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1120/2238] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:44.269641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:44.271606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:44.285027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:44.327825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faa205-cc06-4f03-8068-ed8d10aeedd3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:44.331484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:44.332261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:44.332559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:44.333331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:44.342577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:44.343983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:44.354099 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1119/2239] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:44.818689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:44.820171 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:44.832743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0250f-b6d0-44a7-a534-441576bcf61e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:44.838596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:44.839248 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:44.839507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:44.839781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] PATH_INFO: `/v3/projects/2e921ec1355e43a7af021334f8b0979f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:44.840936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e921ec1355e43a7af021334f8b0979f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:44.842903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:44.919238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e921ec1355e43a7af021334f8b0979f', 'request_id': 'req-a76f8825-e4c5-42a8-8705-9ffaf1e43871'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.925800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e921ec1355e43a7af021334f8b0979f', 'request_id': 'req-a76f8825-e4c5-42a8-8705-9ffaf1e43871'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.987680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e921ec1355e43a7af021334f8b0979f', 'request_id': 'req-a76f8825-e4c5-42a8-8705-9ffaf1e43871'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:44.998450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] The token cache is being invalidate because project 2e921ec1355e43a7af021334f8b0979f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:45.001163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.001163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.001163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1121/2240] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:44 2022] DELETE /identity/v3/projects/2e921ec1355e43a7af021334f8b0979f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:45.005390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:45.014984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ef22-3d29-43d9-9ac2-5f4c6e5bcf08 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:45.069875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:45.070479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:45.070756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:45.071028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] PATH_INFO: `/v3/users/a18d6cdc3e8e432589f7441a7ef9c85a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:45.072120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18d6cdc3e8e432589f7441a7ef9c85a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:45.074042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:45.217745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18d6cdc3e8e432589f7441a7ef9c85a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.223162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18d6cdc3e8e432589f7441a7ef9c85a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.233204 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18d6cdc3e8e432589f7441a7ef9c85a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.240632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18d6cdc3e8e432589f7441a7ef9c85a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.241251 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f569557b-102c-4eaa-ba37-ac47bfa9ee26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18d6cdc3e8e432589f7441a7ef9c85a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.284178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1120/2241] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:45 2022] DELETE /identity/v3/users/a18d6cdc3e8e432589f7441a7ef9c85a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:50:45.641849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:45.644167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:45.665702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8825-e4c5-42a8-8705-9ffaf1e43871 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:45.720856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:45.721476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:45.721784 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:45.722053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] PATH_INFO: `/v3/projects/6dcf40f1f34d4efaa034f04726f72739` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:45.723147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dcf40f1f34d4efaa034f04726f72739)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:45.725777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:45.746640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:45.805407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dcf40f1f34d4efaa034f04726f72739', 'request_id': 'req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.811531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dcf40f1f34d4efaa034f04726f72739', 'request_id': 'req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.867957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dcf40f1f34d4efaa034f04726f72739', 'request_id': 'req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.878948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] The token cache is being invalidate because project 6dcf40f1f34d4efaa034f04726f72739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:45.880818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.880818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-36acbc76-129b-47f2-bfe2-ca7bce3f12fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:45.881270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1122/2242] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:45 2022] DELETE /identity/v3/projects/6dcf40f1f34d4efaa034f04726f72739 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:45.886427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:45.886710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:45.887094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:45.906989 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:45.908173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:45.936643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:45.966085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1121/2243] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:46.030588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.030875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.031154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.051231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:46.052431 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:46.060348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1123/2244] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:46.064468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.074621 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ec8cc-749d-4107-a047-2e64f0534c4c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.079090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.079676 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.079952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.080225 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.080856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:46.081154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.082774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.094739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1122/2245] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:50:46.098821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.107864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df49e48-594f-448f-a542-9c2c33c76a86 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.114290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.114882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.115160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.115432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.116089 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.118010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.195970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1124/2246] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:46 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:46.200146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.210988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f3c2a-0aaf-4988-b02a-b33828d8d8ef admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.269035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.269662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.269941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.270210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.271455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.273343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.348011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1123/2247] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:46 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:46.352147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.362691 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980d5a-1964-4a00-8170-244d4f4f829f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.367389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.367977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.368252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.368604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.369237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.370887 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.381392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1125/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:50:46.385131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.394865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a750e6f-881d-4ad6-b90d-9e7147c3fb68 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.399981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a374-763e-488d-b36e-e2be38280fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.400555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a374-763e-488d-b36e-e2be38280fee admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.400832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a374-763e-488d-b36e-e2be38280fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.401101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a374-763e-488d-b36e-e2be38280fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.401758 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a374-763e-488d-b36e-e2be38280fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.403325 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a374-763e-488d-b36e-e2be38280fee admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.413680 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1124/2249] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:46.417564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.427712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5062-fda2-4ff4-b186-e9c1e489e82f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.432359 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.432985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.433264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.433566 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] PATH_INFO: `/v3/projects/2b3d8680e9264f079789219776322fad/users/b5b8382d8eb348bda2d0b3bd54eddfba/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.448421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3d8680e9264f079789219776322fad, user_id=b5b8382d8eb348bda2d0b3bd54eddfba, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.451096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.508755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1126/2250] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:46 2022] PUT /identity/v3/projects/2b3d8680e9264f079789219776322fad/users/b5b8382d8eb348bda2d0b3bd54eddfba/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:46.519055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.524333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.524333 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.547305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] MFA Rules not processed for user `b5b8382d8eb348bda2d0b3bd54eddfba`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:46.548498 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:46.611354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1125/2251] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:46.616393 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.676005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbc360-ed52-4735-ae54-be44d258bf2d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.681027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.681653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.681935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.682210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.682840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.684765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:46.817563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1127/2252] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:46 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:46.821678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:46.832127 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbaa31-e439-41f0-8588-2d036c224e53 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:46.857911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:46.887852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:46.888382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:46.888660 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:46.888939 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:46.889596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:46.891524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:47.005343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1126/2253] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:46 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:47.009313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:47.019780 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0738e-d061-4dbd-95ae-c4be2c9b129f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:47.026135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:47.026135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:47.026135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:47.026135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:47.026733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:47.028343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:47.039533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1128/2254] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:47.043700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:47.054581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276f0b-4ce3-4855-bb39-18cdccb5e6f0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:47.059352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:47.059993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:47.060274 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:47.060549 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] PATH_INFO: `/v3/projects/ea42e731df8c475987ba6943b04c2315/users/5bb45ddabb9f4fbc9d0805bdcb267360/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:47.075096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea42e731df8c475987ba6943b04c2315, user_id=5bb45ddabb9f4fbc9d0805bdcb267360, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:47.077765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:47.142136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1127/2255] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:47 2022] PUT /identity/v3/projects/ea42e731df8c475987ba6943b04c2315/users/5bb45ddabb9f4fbc9d0805bdcb267360/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:47.146512 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:47.156370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868c38e-4795-4f1f-9d3a-afee824d9aec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:47.169232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:47.211125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acad2-58c4-4028-be07-b881f26d3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:47.211724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acad2-58c4-4028-be07-b881f26d3ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:47.212006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acad2-58c4-4028-be07-b881f26d3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:47.212312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acad2-58c4-4028-be07-b881f26d3ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:47.212947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acad2-58c4-4028-be07-b881f26d3ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:47.214588 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acad2-58c4-4028-be07-b881f26d3ba6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:47.228759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1129/2256] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:50:47.230063 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:47.240537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ef3d-e7df-4bed-a59d-1772b0dbde2c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:47.245017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:47.245686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:47.245966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:47.246241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] PATH_INFO: `/v3/projects/ea42e731df8c475987ba6943b04c2315/users/5bb45ddabb9f4fbc9d0805bdcb267360/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:47.248115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea42e731df8c475987ba6943b04c2315, user_id=5bb45ddabb9f4fbc9d0805bdcb267360, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:47.250846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:47.260786 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1128/2257] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:47 2022] PUT /identity/v3/projects/ea42e731df8c475987ba6943b04c2315/users/5bb45ddabb9f4fbc9d0805bdcb267360/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:47.271615 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:47.273813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:47.273813 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:47.299743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] MFA Rules not processed for user `5bb45ddabb9f4fbc9d0805bdcb267360`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:47.300935 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:47.366302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1130/2258] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:47.376866 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:47.378565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:47.434832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a3e50-b655-449d-a4b0-3c9ab0391968 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:47.438329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0bed6-6738-404e-8ce0-118edabc1bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:47.438910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0bed6-6738-404e-8ce0-118edabc1bad service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:47.439183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0bed6-6738-404e-8ce0-118edabc1bad service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:47.439458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0bed6-6738-404e-8ce0-118edabc1bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:47.493924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0bed6-6738-404e-8ce0-118edabc1bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:47.495402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0bed6-6738-404e-8ce0-118edabc1bad service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:47.504273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1129/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:50.525524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:50.587070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80926ff6-4e35-44f4-8878-391a069101b4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:50.591503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:50.592122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:50.592401 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:50.592675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] PATH_INFO: `/v3/users/b5b8382d8eb348bda2d0b3bd54eddfba` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:50.593800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b8382d8eb348bda2d0b3bd54eddfba)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:50.595714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:50.751288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:50.756937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b8382d8eb348bda2d0b3bd54eddfba'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:50.757777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b8382d8eb348bda2d0b3bd54eddfba'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:50.769322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b8382d8eb348bda2d0b3bd54eddfba'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:50.862704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b8382d8eb348bda2d0b3bd54eddfba'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:50.869851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b8382d8eb348bda2d0b3bd54eddfba'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:50.875612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1131/2260] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:50 2022] DELETE /identity/v3/users/b5b8382d8eb348bda2d0b3bd54eddfba => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:50.880625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:50.881077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:50.881170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:50.900762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:50.901980 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:50.931026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:50.959345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1130/2261] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:50.968538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:50.969986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:51.026879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588e348-bf22-467f-822f-1586d8025362 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:51.030347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:51.030943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:51.031217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:51.031491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:51.040108 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:51.041504 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:51.050700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1132/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:50:51.441410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:51.442840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:51.455289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02694ba0-f912-4cd4-8aa5-9e653c0cd731 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:51.460009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:51.460636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:51.460913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:51.461182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] PATH_INFO: `/v3/projects/2b3d8680e9264f079789219776322fad` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:51.462382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3d8680e9264f079789219776322fad)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:51.464281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:51.618327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3d8680e9264f079789219776322fad', 'request_id': 'req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.624842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3d8680e9264f079789219776322fad', 'request_id': 'req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.691051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3d8680e9264f079789219776322fad', 'request_id': 'req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.701365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] The token cache is being invalidate because project 2b3d8680e9264f079789219776322fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:51.701703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.702321 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.703776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1131/2263] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:51 2022] DELETE /identity/v3/projects/2b3d8680e9264f079789219776322fad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:51.707883 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:51.718135 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c5135-57b7-46e8-8dcc-c1099bc91753 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:51.774929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:51.775539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:51.775815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:51.776087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] PATH_INFO: `/v3/users/5bb45ddabb9f4fbc9d0805bdcb267360` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:51.777183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb45ddabb9f4fbc9d0805bdcb267360)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:51.779096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:51.932919 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb45ddabb9f4fbc9d0805bdcb267360'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.933478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb45ddabb9f4fbc9d0805bdcb267360'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:51.944304 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:51.945667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb45ddabb9f4fbc9d0805bdcb267360'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.006141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb45ddabb9f4fbc9d0805bdcb267360'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.013429 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c6d9ea0-f8ef-4ba7-92ef-15df0a665ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb45ddabb9f4fbc9d0805bdcb267360'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.019651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1133/2264] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:51 2022] DELETE /identity/v3/users/5bb45ddabb9f4fbc9d0805bdcb267360 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:52.389795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:52.391286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:52.404873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4326-36aa-4c5f-8bc7-676c7fd1d0a1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:52.462590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:52.463142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:52.463419 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:52.463688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] PATH_INFO: `/v3/projects/ea42e731df8c475987ba6943b04c2315` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:52.464808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea42e731df8c475987ba6943b04c2315)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:52.466729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:52.565202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea42e731df8c475987ba6943b04c2315', 'request_id': 'req-cd41d8e1-7fc9-4c63-8e33-112bebab5280'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.571397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea42e731df8c475987ba6943b04c2315', 'request_id': 'req-cd41d8e1-7fc9-4c63-8e33-112bebab5280'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.645259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea42e731df8c475987ba6943b04c2315', 'request_id': 'req-cd41d8e1-7fc9-4c63-8e33-112bebab5280'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.647081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:52.656736 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] The token cache is being invalidate because project ea42e731df8c475987ba6943b04c2315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:52.657042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.657669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:52.659181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1132/2265] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:52 2022] DELETE /identity/v3/projects/ea42e731df8c475987ba6943b04c2315 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:02.102654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:02.777034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=2,keystone:SELECT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:08.299256 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42ce5-5d60-41b9-a966-c4dff32e38f5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:08.299758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42ce5-5d60-41b9-a966-c4dff32e38f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:08.299938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42ce5-5d60-41b9-a966-c4dff32e38f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:08.319412 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d2d42ce5-5d60-41b9-a966-c4dff32e38f5 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:08.320617 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d2d42ce5-5d60-41b9-a966-c4dff32e38f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:08.376767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1134/2266] 10.222.0.26 () {58 vars in 967 bytes} [Wed Nov 2 07:51:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:08.535177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:08.536583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:08.605158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d8e1-7fc9-4c63-8e33-112bebab5280 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:08.610347 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:08.610938 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:08.611213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:08.611481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:08.619364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:08.620923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:08.628774 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1133/2267] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:51:16.545420 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:16.545949 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:16.546051 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:16.587202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] MFA Rules not processed for user `381a9a193fb44afca97b07e550b694db`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:16.587202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:16.713712 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1135/2268] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:17.119429 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:17.121415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:17.198081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bbf87-3ed5-44cf-b096-6f61c96461c3 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:17.201720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:17.202374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:17.202652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:17.202924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:17.204627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:17.214062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:17.215478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:17.224782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1134/2269] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:17.835435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:17.838215 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:17.932941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:17.940667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a41f2-cdb1-4a3b-8b52-6af2f563ebd9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:17.946418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:17.947005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:17.947285 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:17.947559 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:17.949435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:17.960900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:17.963552 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:17.972890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1136/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:17.991360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:17.992781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:18.070262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:18.093990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f14e-8557-49b4-b989-ab52c4b4454c service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:18.098698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:18.099319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:18.099602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:18.099875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] PATH_INFO: `/v3/users/da00fba9f8c448bea30684d5736eb8bd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:18.101025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da00fba9f8c448bea30684d5736eb8bd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:18.103023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:18.295891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da00fba9f8c448bea30684d5736eb8bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.296628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da00fba9f8c448bea30684d5736eb8bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.316999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da00fba9f8c448bea30684d5736eb8bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.324561 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da00fba9f8c448bea30684d5736eb8bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.325279 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da00fba9f8c448bea30684d5736eb8bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.403916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1135/2271] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:17 2022] DELETE /identity/v3/users/da00fba9f8c448bea30684d5736eb8bd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:18.620348 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:18.633407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a574b-c010-4367-8e3b-810995cf3cfe service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:18.697877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:18.698110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:18.698289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:18.698538 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] PATH_INFO: `/v3/projects/fcc26adcb6794673b55ae872e7f2f780` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:18.699677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc26adcb6794673b55ae872e7f2f780)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:18.701641 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:18.803916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc26adcb6794673b55ae872e7f2f780', 'request_id': 'req-79cbee53-7801-414f-9033-49647244f950'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.812276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc26adcb6794673b55ae872e7f2f780', 'request_id': 'req-79cbee53-7801-414f-9033-49647244f950'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.898281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc26adcb6794673b55ae872e7f2f780', 'request_id': 'req-79cbee53-7801-414f-9033-49647244f950'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.910339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] The token cache is being invalidate because project fcc26adcb6794673b55ae872e7f2f780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:18.910628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.911271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:18.913004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1137/2272] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:18 2022] DELETE /identity/v3/projects/fcc26adcb6794673b55ae872e7f2f780 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:18.917664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:18.921065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:18.936768 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41eb93-2eaf-40be-883f-09a83c4afea2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:18.995405 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:18.995951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:18.996231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:18.996501 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] PATH_INFO: `/v3/users/0bcabba418944533af516a93b5da6b67` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:18.997637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcabba418944533af516a93b5da6b67)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:18.999575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:19.204181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcabba418944533af516a93b5da6b67'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.204924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcabba418944533af516a93b5da6b67'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.217902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcabba418944533af516a93b5da6b67'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.219244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:19.234230 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcabba418944533af516a93b5da6b67'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.234949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9bdfaec4-09a3-4d25-85ad-dd586a9954d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcabba418944533af516a93b5da6b67'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.298071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1136/2273] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:18 2022] DELETE /identity/v3/users/0bcabba418944533af516a93b5da6b67 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:19.551752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:19.553211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:19.566048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbee53-7801-414f-9033-49647244f950 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:19.624442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:19.625065 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.625345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.625650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] PATH_INFO: `/v3/projects/ecb94b1c5d324db3b1a79f6533544a1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.626761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb94b1c5d324db3b1a79f6533544a1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:19.628765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:19.650500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:19.732577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb94b1c5d324db3b1a79f6533544a1e', 'request_id': 'req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.739271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb94b1c5d324db3b1a79f6533544a1e', 'request_id': 'req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.783700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb94b1c5d324db3b1a79f6533544a1e', 'request_id': 'req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.795186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] The token cache is being invalidate because project ecb94b1c5d324db3b1a79f6533544a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:19.795486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.796116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-67895efd-3ec7-4fbb-8f0e-91bf4336b2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.797600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1138/2274] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:19 2022] DELETE /identity/v3/projects/ecb94b1c5d324db3b1a79f6533544a1e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:19.806740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.806740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.806740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.864733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:19.866434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:19.934928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1137/2275] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:19.942988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.943539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.943539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.964166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:19.965679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:19.976679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1139/2276] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:19.978186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:19.994349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8bc47-ec47-4827-8ff2-db60f2b82349 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.009934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.009934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.009934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.009934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.010315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:51:20.010315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.010315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.023382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1138/2277] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:51:20.028159 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.038329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afb03-5217-4900-9637-d52efe451167 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.043419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.044017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.044293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.044558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.045182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.047120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.145776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1140/2278] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:20 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:20.149678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.159975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4674e6-30b9-49c6-a073-e154603ebdc0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.218171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.219145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.219613 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.220164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.221048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.223177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.307731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1139/2279] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:20 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:51:20.309739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.320986 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3268-33f9-479f-952b-559d38f144f3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.325694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.326402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.326742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.327085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.327794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.329584 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.339998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1141/2280] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:20.344015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.355707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079b90-8a61-4766-97ec-07e1fa61788a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.361590 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3d386-b225-4080-80e6-fb14b36df2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.362410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3d386-b225-4080-80e6-fb14b36df2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.362602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3d386-b225-4080-80e6-fb14b36df2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.362885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3d386-b225-4080-80e6-fb14b36df2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.364616 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3d386-b225-4080-80e6-fb14b36df2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.365131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3d386-b225-4080-80e6-fb14b36df2c6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.379537 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1140/2281] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:20.383541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.394937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b660-317f-4b5b-a412-b5715bbaac8a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.399663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.400801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.400801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.401003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] PATH_INFO: `/v3/projects/460bf30d1ba14df5988c181e0df91b25/users/0588950a2ade4cc4916ed9f024e26b3d/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.416687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460bf30d1ba14df5988c181e0df91b25, user_id=0588950a2ade4cc4916ed9f024e26b3d, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.419389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.494406 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1142/2282] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:20 2022] PUT /identity/v3/projects/460bf30d1ba14df5988c181e0df91b25/users/0588950a2ade4cc4916ed9f024e26b3d/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:20.500738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205da573-a9b8-4d96-962c-97932adccd0d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.501112 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205da573-a9b8-4d96-962c-97932adccd0d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.501486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205da573-a9b8-4d96-962c-97932adccd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.523794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-205da573-a9b8-4d96-962c-97932adccd0d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:20.525823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-205da573-a9b8-4d96-962c-97932adccd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:20.553197 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:20.596620 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1141/2283] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:20.607705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.609385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:20.673716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ae0de-b431-4f6a-9608-065e8df15947 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.677466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.678173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.678515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.679375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.690444 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.692023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.714586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1143/2284] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:23.725046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b82a-ac6c-4922-b088-b962b4bf863f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:23.725574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b82a-ac6c-4922-b088-b962b4bf863f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:23.725685 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b82a-ac6c-4922-b088-b962b4bf863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:23.760375 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9934b82a-ac6c-4922-b088-b962b4bf863f None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:23.761826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9934b82a-ac6c-4922-b088-b962b4bf863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:23.834149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1142/2285] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:51:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:23.847222 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:23.849962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:23.908916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:23.939847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104196e-8f7c-40e9-8b30-a6707a1bef44 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:23.947233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:23.948061 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:23.948407 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:23.948752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:23.958566 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:23.960578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:23.973685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1144/2286] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:51:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:51:27.295014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:27.295539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:27.295539 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:27.374831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] MFA Rules not processed for user `0588950a2ade4cc4916ed9f024e26b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:27.376224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:27.502221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1143/2287] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:27.506608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:27.519982 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eec94-82f8-44d2-aa39-7e4b8d995d80 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:27.525085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:27.525737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:27.526018 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:27.526288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:27.529816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:27.531942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:27.628440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1145/2288] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:27 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:27.629683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:27.652959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482e51-499c-48c9-9b26-23eadbca5913 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:27.745687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:27.781292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:27.783239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:27.784108 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:27.785779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:27.787270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:27.790364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:27.871500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1144/2289] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:27 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:27.875713 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:27.891644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ae80a-949a-4d9a-9e00-f6fdfeb86129 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:27.903060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:27.904199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:27.905032 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:27.905513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:27.906850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:27.909247 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:27.931704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1146/2290] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:51:27.935391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:27.957044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ea493-7ee9-4d10-a072-4c2cffc1a8b3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:27.963992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:27.964673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:27.964956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:27.965232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] PATH_INFO: `/v3/projects/324e2a48cb194dd3bab0b42feaeb29da/users/78ced34e3fa64f04b442b7013b78db46/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:27.989889 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324e2a48cb194dd3bab0b42feaeb29da, user_id=78ced34e3fa64f04b442b7013b78db46, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:27.993311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.056891 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1145/2291] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:27 2022] PUT /identity/v3/projects/324e2a48cb194dd3bab0b42feaeb29da/users/78ced34e3fa64f04b442b7013b78db46/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:28.061720 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.074640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca679-3218-4032-9522-3721f15fa69b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.148377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.148991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.149267 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.149583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.150899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.152614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.164514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1147/2292] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:28.169226 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.182882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29778f-fe2a-425f-b09b-03ee8224f826 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.189066 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae73a9-6278-4127-ac11-a4b285d5fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.189816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae73a9-6278-4127-ac11-a4b285d5fe1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.190058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae73a9-6278-4127-ac11-a4b285d5fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.190346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae73a9-6278-4127-ac11-a4b285d5fe1c admin admin] PATH_INFO: `/v3/projects/324e2a48cb194dd3bab0b42feaeb29da/users/78ced34e3fa64f04b442b7013b78db46/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.192444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae73a9-6278-4127-ac11-a4b285d5fe1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=324e2a48cb194dd3bab0b42feaeb29da, user_id=78ced34e3fa64f04b442b7013b78db46, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.195254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae73a9-6278-4127-ac11-a4b285d5fe1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.211402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1146/2293] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:28 2022] PUT /identity/v3/projects/324e2a48cb194dd3bab0b42feaeb29da/users/78ced34e3fa64f04b442b7013b78db46/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:35.362279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:35.364655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:35.615059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a6654-7b86-4839-9f61-1b40edfe8f0f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:35.653057 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:35.782923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:35.783833 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.784268 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.784705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.787818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:35.809818 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:35.814128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:35.843856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1148/2294] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:37.809518 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf7ff-1b8d-45c6-9037-4c83a22c5816 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.810054 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf7ff-1b8d-45c6-9037-4c83a22c5816 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.810295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf7ff-1b8d-45c6-9037-4c83a22c5816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.845964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d8baf7ff-1b8d-45c6-9037-4c83a22c5816 None None] MFA Rules not processed for user `78ced34e3fa64f04b442b7013b78db46`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:37.847263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d8baf7ff-1b8d-45c6-9037-4c83a22c5816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:37.957323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1147/2295] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:37.971500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.973827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:37.988927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015dc9d-45a9-4b80-92be-c547d123125b service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.995260 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f0848-85fa-4aa8-ba03-a7a0b6ecc64e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.995894 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0848-85fa-4aa8-ba03-a7a0b6ecc64e service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.996820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0848-85fa-4aa8-ba03-a7a0b6ecc64e service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.997106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0848-85fa-4aa8-ba03-a7a0b6ecc64e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:38.084219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f0848-85fa-4aa8-ba03-a7a0b6ecc64e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:38.086176 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f0848-85fa-4aa8-ba03-a7a0b6ecc64e service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:38.098505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1149/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:41.392572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:41.393089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:41.393089 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:41.414579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] MFA Rules not processed for user `0588950a2ade4cc4916ed9f024e26b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:41.416315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:41.424140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1148/2297] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:51:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:48.092976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=54 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:51.407869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:54.017008 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:54.017458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:54.017683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:54.037107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:54.038332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:54.093141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1150/2298] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:51:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:54.105678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:54.172441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2acbc4-92c3-434f-b190-a335f61a4f4f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:54.177360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca2406-5f54-437f-bc8f-7bd0e527f74d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:54.177994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2406-5f54-437f-bc8f-7bd0e527f74d service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:54.178276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2406-5f54-437f-bc8f-7bd0e527f74d service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:54.178548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2406-5f54-437f-bc8f-7bd0e527f74d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:54.186663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2406-5f54-437f-bc8f-7bd0e527f74d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:54.188261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2406-5f54-437f-bc8f-7bd0e527f74d service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:54.196166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1149/2299] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:51:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:52:04.085912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=25 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:04.193029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=32 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:10.446543 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:10.447938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:10.515450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300a2e2-ff14-45a1-8f48-8d0446087368 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:10.520800 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:10.521394 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:10.521700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:10.521972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:10.523626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:10.534533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:10.536082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:10.545649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1151/2300] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:15.647975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:15.648484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:15.648598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:15.671445 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:15.672404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:15.679927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1150/2301] 10.222.0.26 () {58 vars in 967 bytes} [Wed Nov 2 07:52:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:15.705757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:15.717979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d33e-48a6-4786-bea0-3c2a5e54490b service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:15.723085 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:15.723696 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:15.723989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:15.724366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:15.733253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:15.734884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:15.743050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1152/2302] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:52:24.571413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:24.571413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:24.646803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1c56-93f9-40ab-9e12-dc6140491d09 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:24.650341 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:24.650933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:24.651210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:24.651476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:24.660196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:24.661624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:24.670820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1151/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:25.739710 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=38 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:34.666723 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=38 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:20.752435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:20.761597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee5fc0-2a2d-48ac-b00f-6122f5752d7f service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:20.765106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:20.765880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:20.766161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:20.766433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:20.768138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:20.782688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:20.784094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:20.794831 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1153/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:21.976562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:21.985496 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf67c-9880-4182-80ee-ba03d0388ed9 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:21.989885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:21.990494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:21.990776 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:21.991055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:21.992760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:22.012867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:22.017299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:22.025479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1152/2305] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:30.790041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:31.624195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:31.633411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e5eb-4e47-4425-b06f-507c766f1cd0 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:31.637132 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:31.637767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:31.638050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:31.638326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:31.640048 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:31.702450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:31.703880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:31.713772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1154/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:32.015349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:32.023805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0ce3e-9d5a-4417-be8a-369a5c8c3559 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:32.027425 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:32.028013 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:32.028287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:32.028555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:32.030265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:32.042552 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:32.043962 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:32.054134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1153/2307] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:35.577329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:35.593370 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:35.632041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2cd09-8fdb-4194-a789-c70474d2744b service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:35.643270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:35.644194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:35.644643 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:35.645269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] PATH_INFO: `/v3/users/381a9a193fb44afca97b07e550b694db` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:35.646693 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381a9a193fb44afca97b07e550b694db)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:35.649719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:35.785156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:35.787023 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:35.805873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da071e9-5b07-43dd-9b9b-dab24dcea482 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:35.810830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:35.811460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:35.811739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:35.812016 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] PATH_INFO: `/v3/users/a881b31e78e7433bb3eab1608884ae1e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:35.826284 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a881b31e78e7433bb3eab1608884ae1e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:35.830009 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:35.887792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381a9a193fb44afca97b07e550b694db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:35.888893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381a9a193fb44afca97b07e550b694db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:35.902150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381a9a193fb44afca97b07e550b694db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:35.986126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381a9a193fb44afca97b07e550b694db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:35.994516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381a9a193fb44afca97b07e550b694db'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.000502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1155/2308] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:35 2022] DELETE /identity/v3/users/381a9a193fb44afca97b07e550b694db => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:36.028812 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a881b31e78e7433bb3eab1608884ae1e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.029478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a881b31e78e7433bb3eab1608884ae1e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.042784 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a881b31e78e7433bb3eab1608884ae1e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.051077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a881b31e78e7433bb3eab1608884ae1e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.053331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a881b31e78e7433bb3eab1608884ae1e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.129037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1154/2309] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:35 2022] DELETE /identity/v3/users/a881b31e78e7433bb3eab1608884ae1e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:36.223197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.228201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:36.299437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125458c0-3a5b-4e9c-b2ba-9bc0f35097e6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.311639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:36.356768 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.357402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.357928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.358192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] PATH_INFO: `/v3/projects/d7f2de7ef6924f53a50e8f8fa33fb6e3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.365814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.366102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f2de7ef6924f53a50e8f8fa33fb6e3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.366266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:36.366480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.386463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194db1a4-99d6-4781-88ba-c50e3ca315eb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.392884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.393508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.394472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.394754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] PATH_INFO: `/v3/projects/5eb23720bea740eea688e561b98b5121` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.405772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb23720bea740eea688e561b98b5121)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.407703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.447152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f2de7ef6924f53a50e8f8fa33fb6e3', 'request_id': 'req-be5d5ef8-961c-4ca7-802d-46af7c229fb9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.454155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f2de7ef6924f53a50e8f8fa33fb6e3', 'request_id': 'req-be5d5ef8-961c-4ca7-802d-46af7c229fb9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.495404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb23720bea740eea688e561b98b5121', 'request_id': 'req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.502453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb23720bea740eea688e561b98b5121', 'request_id': 'req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.521223 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f2de7ef6924f53a50e8f8fa33fb6e3', 'request_id': 'req-be5d5ef8-961c-4ca7-802d-46af7c229fb9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.530537 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] The token cache is being invalidate because project d7f2de7ef6924f53a50e8f8fa33fb6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:36.530934 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.531631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be5d5ef8-961c-4ca7-802d-46af7c229fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.533234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1156/2310] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:36 2022] DELETE /identity/v3/projects/d7f2de7ef6924f53a50e8f8fa33fb6e3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:53:36.538044 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769c03-5556-48da-86cd-9b712cb23a54 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.538331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769c03-5556-48da-86cd-9b712cb23a54 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.538609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81769c03-5556-48da-86cd-9b712cb23a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.558807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-81769c03-5556-48da-86cd-9b712cb23a54 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:36.560010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81769c03-5556-48da-86cd-9b712cb23a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:36.563622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb23720bea740eea688e561b98b5121', 'request_id': 'req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.576811 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] The token cache is being invalidate because project 5eb23720bea740eea688e561b98b5121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:36.577232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.578184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-476433a5-2bb9-4754-a2ff-a00b3cbd24bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:36.584787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1155/2311] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:36 2022] DELETE /identity/v3/projects/5eb23720bea740eea688e561b98b5121 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:36.586363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aca39-19d8-4b02-9703-4c531a3d3b0d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.586751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aca39-19d8-4b02-9703-4c531a3d3b0d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.587221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3aca39-19d8-4b02-9703-4c531a3d3b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.609140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5f3aca39-19d8-4b02-9703-4c531a3d3b0d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:36.610452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f3aca39-19d8-4b02-9703-4c531a3d3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:36.615299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:36.630513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1157/2312] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:36.638040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.638329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.638607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.658762 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:36.660203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:36.668122 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1158/2313] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:53:36.672274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.673937 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1156/2314] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:36.681920 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.682168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.682440 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.684736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e2e04-c288-452b-9575-eb552cd6ca2d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.689572 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.692231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.692231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.692231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.692231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:53:36.692639 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.693946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.703246 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:36.704450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:36.705842 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1159/2315] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:53:36.710869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.717145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1157/2316] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:53:36.720915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.721437 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8ec4-df54-452d-902c-cbd781375fa5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.726091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.726674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.726952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.727272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.728027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.729951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.730091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171be6e-f3b6-456c-a65b-36baf08c2b22 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.734802 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.735378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.735658 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.735933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.736574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:53:36.736878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.738531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.751152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1158/2317] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:53:36.754964 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:36.756236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.765844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcdda-ddf3-4489-9e5f-2853f01f066d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.781954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.781954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.781954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.781954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.782346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.782346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.833781 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1160/2318] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:36.837981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.862311 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1159/2319] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:36.866945 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:36.904070 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5987f-8dc6-4e69-a8c4-8d4c87608c23 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.930513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3717676-3248-480f-a4d0-24cb6064eb0c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:36.937973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.937973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.937973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.937973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.938390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.938999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:36.961115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:36.961754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:36.962035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:36.962306 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:36.962924 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:36.964805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.037568 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1160/2320] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:37.041845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.048770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1161/2321] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:36 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:37.052324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ca6c3-2bbc-4d78-b4c2-33dc4a8918cc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.053153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.057029 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.057643 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.057971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.058250 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.058949 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.060527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.063143 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4d380-621c-421b-af98-cd4ac7be1062 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.068593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.069182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.069466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.069771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.070415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.071164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1161/2322] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:53:37.072016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.078363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.084923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1162/2323] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:53:37.086017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.088430 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586a3e8-2a8c-4776-9c20-d5b35f96644b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.093062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.093756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.094034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.094306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.094956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.095648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3596-743e-4205-a63d-bb8365727b5e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.096664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.100263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.100851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.101125 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.101399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.102064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.103621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.107514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1162/2324] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:53:37.111470 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.115318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1163/2325] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:37.119072 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.123156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223c57-0952-43b5-8bf7-6f3d3ca8cca7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.128072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fc77d-bd7e-44fe-b76e-04c1d2527165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.129179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f360cf-ef27-4045-be9e-69d650c56969 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.129449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc77d-bd7e-44fe-b76e-04c1d2527165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.129764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc77d-bd7e-44fe-b76e-04c1d2527165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.130037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fc77d-bd7e-44fe-b76e-04c1d2527165 admin admin] PATH_INFO: `/v3/projects/290c5c3de81e465a928790bd302b586c/users/0cd93ac9a7a94c6fbf0652931c2e28e0/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.133811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5f423-ea06-4bb5-8617-66cff4e43a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.134490 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f423-ea06-4bb5-8617-66cff4e43a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.134772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f423-ea06-4bb5-8617-66cff4e43a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.135046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f423-ea06-4bb5-8617-66cff4e43a41 admin admin] PATH_INFO: `/v3/projects/067034b94cc1492797bd3f9c9b415137/users/b56ce65c523849fabfd7ee29249417f8/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.145276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fc77d-bd7e-44fe-b76e-04c1d2527165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290c5c3de81e465a928790bd302b586c, user_id=0cd93ac9a7a94c6fbf0652931c2e28e0, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.148371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fc77d-bd7e-44fe-b76e-04c1d2527165 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.149361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5f423-ea06-4bb5-8617-66cff4e43a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067034b94cc1492797bd3f9c9b415137, user_id=b56ce65c523849fabfd7ee29249417f8, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.152015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5f423-ea06-4bb5-8617-66cff4e43a41 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.209171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1163/2326] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:37 2022] PUT /identity/v3/projects/290c5c3de81e465a928790bd302b586c/users/0cd93ac9a7a94c6fbf0652931c2e28e0/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:53:37.220648 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.220935 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.221232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.229433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1164/2327] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:37 2022] PUT /identity/v3/projects/067034b94cc1492797bd3f9c9b415137/users/b56ce65c523849fabfd7ee29249417f8/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:53:37.234812 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.235092 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.235365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.246339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:37.254322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] MFA Rules not processed for user `0cd93ac9a7a94c6fbf0652931c2e28e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:37.255158 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:37.255545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:37.256310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:37.296683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:37.315974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1165/2328] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:37.325314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1164/2329] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:37.331783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.331783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:37.341645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.343170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:37.386415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174f113-2b2f-494f-a47d-fafd733e685d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.390283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.390888 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.391164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.391433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.402687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.404364 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.414817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1166/2330] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:53:37.430671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815de9-0693-4b25-b04e-187bde03c97e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.436472 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f28bd-efdc-4095-bd8c-2edee71ec312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.437359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f28bd-efdc-4095-bd8c-2edee71ec312 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.437485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f28bd-efdc-4095-bd8c-2edee71ec312 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.437816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f28bd-efdc-4095-bd8c-2edee71ec312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.446870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f28bd-efdc-4095-bd8c-2edee71ec312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.450577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f28bd-efdc-4095-bd8c-2edee71ec312 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.458441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1165/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:53:37.682238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:37.692233 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d372f0e-a568-4ee4-b6af-272221e33102 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:37.704550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:37.704550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:37.704550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:37.704550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] PATH_INFO: `/v3/users/0cd93ac9a7a94c6fbf0652931c2e28e0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:37.705518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd93ac9a7a94c6fbf0652931c2e28e0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:37.705518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:37.944495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd93ac9a7a94c6fbf0652931c2e28e0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:37.945170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd93ac9a7a94c6fbf0652931c2e28e0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:37.959738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd93ac9a7a94c6fbf0652931c2e28e0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.060488 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd93ac9a7a94c6fbf0652931c2e28e0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.069500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd93ac9a7a94c6fbf0652931c2e28e0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.075671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1167/2332] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:37 2022] DELETE /identity/v3/users/0cd93ac9a7a94c6fbf0652931c2e28e0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:38.080296 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:38.081220 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:38.082088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:38.101663 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:38.102870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:38.163852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1166/2333] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:53:38.174372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:38.176452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:38.240218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50e2c9-4697-41bd-8737-eacf238abe36 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:38.244251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691aa1e-59cf-46e0-8f6f-2cbce8870a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:38.244864 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691aa1e-59cf-46e0-8f6f-2cbce8870a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:38.245146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691aa1e-59cf-46e0-8f6f-2cbce8870a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:38.245423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691aa1e-59cf-46e0-8f6f-2cbce8870a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:38.254834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691aa1e-59cf-46e0-8f6f-2cbce8870a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:38.256197 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691aa1e-59cf-46e0-8f6f-2cbce8870a98 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:38.265855 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1168/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:53:38.702262 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:38.703868 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:38.717953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8603e-2fe5-4f34-bbc2-427ad5941a5e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:38.722584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:38.723337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:38.728767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:38.728767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] PATH_INFO: `/v3/projects/290c5c3de81e465a928790bd302b586c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:38.728767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290c5c3de81e465a928790bd302b586c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:38.728767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:38.750025 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:38.867076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290c5c3de81e465a928790bd302b586c', 'request_id': 'req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.874129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290c5c3de81e465a928790bd302b586c', 'request_id': 'req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.923837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290c5c3de81e465a928790bd302b586c', 'request_id': 'req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.936120 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] The token cache is being invalidate because project 290c5c3de81e465a928790bd302b586c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:38.937740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.937740 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84d3d80c-cafa-4c6d-aa8f-ffa7746ff8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:38.939591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1167/2335] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:38 2022] DELETE /identity/v3/projects/290c5c3de81e465a928790bd302b586c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:38.944770 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:38.945289 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:38.945598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:38.954141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:38.970465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:38.972037 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:39.038764 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1169/2336] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:39.047468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.047803 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.048101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.070624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:39.072278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:39.085295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1168/2337] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:39.091374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.099455 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97996c-f08e-400d-8031-0dec0324d538 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.104995 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.106062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.106580 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.107069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.107955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:53:39.108502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.110562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.124890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1170/2338] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:53:39.130042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.140322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9f13e-5d89-4bbe-930b-5d37e641685f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.151990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.152617 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.153094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.153367 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.154510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.156426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.283165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1169/2339] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:39 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:39.285115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.296558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987f95-1ec6-4645-bcc1-6a68392b49c6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.353625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.354219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.354495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.354765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.355374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.357316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.434173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1171/2340] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:39 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:39.438219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.451210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb254bc8-d496-4e20-9b95-cbfca8311b4b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.456229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.456853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.457129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.457478 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.458072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.459772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.471349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1170/2341] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:53:39.475923 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.488875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2e50-4969-4964-b26e-734b851cf56f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.494102 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4a4be-bac7-478a-9604-cde6e96fcd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.495017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a4be-bac7-478a-9604-cde6e96fcd2a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.495360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a4be-bac7-478a-9604-cde6e96fcd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.495695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4a4be-bac7-478a-9604-cde6e96fcd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.496550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4a4be-bac7-478a-9604-cde6e96fcd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.498539 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4a4be-bac7-478a-9604-cde6e96fcd2a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.510688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1172/2342] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:39.515079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.526769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be552d4f-6ef0-4743-b5d4-f86f76bf4542 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.545343 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.546442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.546442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.557977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] PATH_INFO: `/v3/projects/448693e2828840298739657b4857a947/users/04994e335d6541bc85128c53e7dab436/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.580640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448693e2828840298739657b4857a947, user_id=04994e335d6541bc85128c53e7dab436, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.583390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.669334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1171/2343] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:39 2022] PUT /identity/v3/projects/448693e2828840298739657b4857a947/users/04994e335d6541bc85128c53e7dab436/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:39.671101 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.671640 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.672124 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.704195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] MFA Rules not processed for user `04994e335d6541bc85128c53e7dab436`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:39.705405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:39.768120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:39.774145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1173/2344] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:39.778580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.847124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c37d7f-b6fa-4434-931e-8240251c2c70 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:39.853196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:39.853840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:39.854124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:39.854397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:39.855299 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:39.857564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:39.985309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1172/2345] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:39 2022] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:39.986943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:39.999500 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e48bb9-c486-44e9-b054-77db618d094b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.070116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.071073 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.071321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.071654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.072193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:40.074998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:40.167427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1174/2346] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:39 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:40.168734 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:40.180177 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061855-2c69-44de-b9b0-1b95da8f5514 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.184762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.185460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.185890 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.186170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.186836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:40.188427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:40.200975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1173/2347] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:40.209294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:40.217320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d4704-d39a-49e6-a80b-f90359519060 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.222789 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.223495 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.223844 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.224052 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] PATH_INFO: `/v3/projects/c69a1d59e53340d98494b9c91ce7a83f/users/abbdab459a5744b7a75fce36dca1ba11/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.243152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69a1d59e53340d98494b9c91ce7a83f, user_id=abbdab459a5744b7a75fce36dca1ba11, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:40.245921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:40.312631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1175/2348] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:40 2022] PUT /identity/v3/projects/c69a1d59e53340d98494b9c91ce7a83f/users/abbdab459a5744b7a75fce36dca1ba11/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:40.317628 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:40.327772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab98f8-e94a-4d80-9862-9912d080e30d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.349158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:40.400559 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff66c9a-1802-4b4e-b9d1-295233417e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.401416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66c9a-1802-4b4e-b9d1-295233417e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.401815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66c9a-1802-4b4e-b9d1-295233417e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.402159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff66c9a-1802-4b4e-b9d1-295233417e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.402990 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66c9a-1802-4b4e-b9d1-295233417e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:40.405374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff66c9a-1802-4b4e-b9d1-295233417e59 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:40.418546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1174/2349] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:53:40.422931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:40.450661 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f529f72-b069-473d-86a8-46da0a92bc5d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.460367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.461606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.461940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.463884 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] PATH_INFO: `/v3/projects/c69a1d59e53340d98494b9c91ce7a83f/users/abbdab459a5744b7a75fce36dca1ba11/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.468169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69a1d59e53340d98494b9c91ce7a83f, user_id=abbdab459a5744b7a75fce36dca1ba11, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:40.472849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:40.496803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1176/2350] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:40 2022] PUT /identity/v3/projects/c69a1d59e53340d98494b9c91ce7a83f/users/abbdab459a5744b7a75fce36dca1ba11/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:40.507536 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.507824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.508094 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.542147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] MFA Rules not processed for user `abbdab459a5744b7a75fce36dca1ba11`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:40.543762 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:40.639329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1175/2351] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:40.653252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:40.653252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:40.765038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851cc05-d700-4c51-9c7d-3b12511d23c9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.771702 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c4bf1-8015-4a9e-bbc3-ff5f06dc248c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.772606 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4bf1-8015-4a9e-bbc3-ff5f06dc248c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.772956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4bf1-8015-4a9e-bbc3-ff5f06dc248c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.773241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c4bf1-8015-4a9e-bbc3-ff5f06dc248c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:40.783877 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4bf1-8015-4a9e-bbc3-ff5f06dc248c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:40.786185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c4bf1-8015-4a9e-bbc3-ff5f06dc248c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:40.796688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1177/2352] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:53:40.924957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:40.926069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:40.940213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf306-32e0-4c81-b32d-ced6de941251 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:40.944350 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:40.945098 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:40.945408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:40.945722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:41.004753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:41.005994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:41.016270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1176/2353] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:42.955038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b29e-d1f3-4638-a3b0-6057c92e1ff4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:42.955038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b29e-d1f3-4638-a3b0-6057c92e1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:42.955038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b29e-d1f3-4638-a3b0-6057c92e1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:42.981676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8576b29e-d1f3-4638-a3b0-6057c92e1ff4 None None] MFA Rules not processed for user `b56ce65c523849fabfd7ee29249417f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:42.982903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8576b29e-d1f3-4638-a3b0-6057c92e1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:43.005321 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:43.056003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1178/2354] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:43.074247 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:43.075665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:43.133659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:43.177517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28f55-f90d-40e6-93da-d565ea172980 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:43.184494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:43.185100 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:43.185380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:43.188854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:43.198464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:43.200122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:43.211088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1177/2355] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:45.709629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df71d4-94d3-4dae-a052-62b260e00374 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:45.710152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df71d4-94d3-4dae-a052-62b260e00374 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:45.710987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df71d4-94d3-4dae-a052-62b260e00374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:45.730151 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f4df71d4-94d3-4dae-a052-62b260e00374 None None] MFA Rules not processed for user `b56ce65c523849fabfd7ee29249417f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:45.731356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f4df71d4-94d3-4dae-a052-62b260e00374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:45.738612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1179/2356] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:46.054720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:46.130285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4611-1172-4d16-9306-a9f2c6ca9e1f service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:46.134905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:46.135745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:46.135887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:46.136110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] PATH_INFO: `/v3/users/04994e335d6541bc85128c53e7dab436` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:46.137264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04994e335d6541bc85128c53e7dab436)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:46.139288 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:46.283110 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04994e335d6541bc85128c53e7dab436'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:46.283819 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04994e335d6541bc85128c53e7dab436'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:46.299884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04994e335d6541bc85128c53e7dab436'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:46.320061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04994e335d6541bc85128c53e7dab436'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:46.320795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04994e335d6541bc85128c53e7dab436'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:46.415860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1178/2357] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:46 2022] DELETE /identity/v3/users/04994e335d6541bc85128c53e7dab436 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:46.420352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:46.420727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:46.421068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:46.446959 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:46.448592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:46.523714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1180/2358] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:53:46.535671 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:46.537024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:46.626070 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:46.654632 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d981e-c1c0-491f-9e36-799f1cc490c9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:46.663837 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:46.665037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:46.665037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:46.665669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:46.677972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:46.679751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:46.692965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1179/2359] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:47.347563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:47.349707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:47.366627 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97545f48-2498-4adb-bbe3-077a671b9021 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:47.372336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:47.373010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:47.373245 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:47.373510 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] PATH_INFO: `/v3/projects/448693e2828840298739657b4857a947` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:47.374705 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=448693e2828840298739657b4857a947)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:47.376820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:47.513446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448693e2828840298739657b4857a947', 'request_id': 'req-46e48e9f-a049-41ea-bb31-26b54f02d23c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.519868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448693e2828840298739657b4857a947', 'request_id': 'req-46e48e9f-a049-41ea-bb31-26b54f02d23c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.615046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448693e2828840298739657b4857a947', 'request_id': 'req-46e48e9f-a049-41ea-bb31-26b54f02d23c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.626004 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] The token cache is being invalidate because project 448693e2828840298739657b4857a947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:47.626290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.626912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.629030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1181/2360] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:47 2022] DELETE /identity/v3/projects/448693e2828840298739657b4857a947 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:47.632973 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:47.642782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a8d0-b6c3-474e-9bf4-bd5a81ad7c21 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:47.699637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:47.700268 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:47.700546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:47.700823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] PATH_INFO: `/v3/users/abbdab459a5744b7a75fce36dca1ba11` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:47.701974 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbdab459a5744b7a75fce36dca1ba11)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:47.703897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:47.978322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbdab459a5744b7a75fce36dca1ba11'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.978895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbdab459a5744b7a75fce36dca1ba11'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.991986 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbdab459a5744b7a75fce36dca1ba11'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.998781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbdab459a5744b7a75fce36dca1ba11'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:47.999458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-845f8460-1b31-401e-a283-1b969032e628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbdab459a5744b7a75fce36dca1ba11'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:48.077507 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1180/2361] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:47 2022] DELETE /identity/v3/users/abbdab459a5744b7a75fce36dca1ba11 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:48.451597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:48.453805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:48.472388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e48e9f-a049-41ea-bb31-26b54f02d23c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:48.517927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:48.538893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:48.539619 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:48.539896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:48.540166 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] PATH_INFO: `/v3/projects/c69a1d59e53340d98494b9c91ce7a83f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:48.541279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69a1d59e53340d98494b9c91ce7a83f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:48.543350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:48.644766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69a1d59e53340d98494b9c91ce7a83f', 'request_id': 'req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:48.651148 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69a1d59e53340d98494b9c91ce7a83f', 'request_id': 'req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:48.694829 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69a1d59e53340d98494b9c91ce7a83f', 'request_id': 'req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:48.705458 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] The token cache is being invalidate because project c69a1d59e53340d98494b9c91ce7a83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:48.705775 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:48.706983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d27bbf68-9e12-4edf-b500-7e46ec9e0de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:48.708516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1182/2362] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:48 2022] DELETE /identity/v3/projects/c69a1d59e53340d98494b9c91ce7a83f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:48.713474 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:48.713951 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:48.714069 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:48.735705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:48.736954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:48.800314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1181/2363] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:48.808722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:48.809196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:48.809561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:48.830673 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:48.832527 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:48.852109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1183/2364] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:48.856467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:48.867132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f9e9-1747-45c8-acb0-2bac4eb6f632 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:48.871852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:48.872436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:48.872711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:48.872977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:48.873738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:53:48.874042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:48.875610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:48.877156 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:48.888129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1182/2365] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:53:48.892607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:48.902386 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fb56-d8a6-40b3-b72a-de32f1c94500 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:48.906961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:48.907550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:48.907827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:48.908096 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:48.908726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:48.911287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.003692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1184/2366] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:48 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:49.004770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.015020 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0b162-e56e-42a2-9822-51481e5b31af admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.075917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.079210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.079210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.079210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.079210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.079859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.221787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1183/2367] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:49 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:49.225771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.240087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e3118-1f20-4e6d-aed8-1deaa1b4771d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.245945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.246554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.246849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.247110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.247744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.249337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.261658 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1185/2368] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:49.264206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.276244 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f596557-150f-469d-98de-4aa5c97c85b5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.280917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0fa4-ef5d-4fa1-9fe7-fd177decce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.281508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0fa4-ef5d-4fa1-9fe7-fd177decce4a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.281827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0fa4-ef5d-4fa1-9fe7-fd177decce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.282147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0fa4-ef5d-4fa1-9fe7-fd177decce4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.282789 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0fa4-ef5d-4fa1-9fe7-fd177decce4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.284372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0fa4-ef5d-4fa1-9fe7-fd177decce4a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.294944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1184/2369] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:49.303069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.312984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479091-6ecd-4010-b2be-c40ef5c03e95 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.318265 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.318912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.319210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.319466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] PATH_INFO: `/v3/projects/246b9e9d2e734766953419dfba08f9ca/users/3df1363e67384a898cdb803109f9533b/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.334718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246b9e9d2e734766953419dfba08f9ca, user_id=3df1363e67384a898cdb803109f9533b, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.337352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.403867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1186/2370] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:49 2022] PUT /identity/v3/projects/246b9e9d2e734766953419dfba08f9ca/users/3df1363e67384a898cdb803109f9533b/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:49.415196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.415485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.415756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.443605 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] MFA Rules not processed for user `3df1363e67384a898cdb803109f9533b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:49.444838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:49.512805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1185/2371] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:49.517322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.584896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0fecd-da31-4b57-bb32-af6107029a76 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.589645 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.590791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.590791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.590791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.591400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.593303 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.604496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:49.667765 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1187/2372] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:49 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:49.671911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.683223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda3448-3a22-4821-a04d-e0296be0bbff None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.740697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.741355 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.741599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.741878 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.742509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.744428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.754408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:49.841985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1186/2373] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:49 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:49.843743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.855469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ba9cb-b239-47d9-a670-1dbd10a09788 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.861214 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.863039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.863039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.863337 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.864129 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.865958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:49.878880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1188/2374] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:49.883139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:49.895690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a3cd-8229-498f-85fb-1e6c4aff01e7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:49.900961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:49.901919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:49.904122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:49.904122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] PATH_INFO: `/v3/projects/13a168b3c3d14157a53ab805e862829c/users/f4c16e3ebe074391912c6f667adde790/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:49.921116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a168b3c3d14157a53ab805e862829c, user_id=f4c16e3ebe074391912c6f667adde790, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:49.923580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:50.015479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1187/2375] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:49 2022] PUT /identity/v3/projects/13a168b3c3d14157a53ab805e862829c/users/f4c16e3ebe074391912c6f667adde790/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:50.019523 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:50.041234 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91249b-ab2c-4b40-a326-20435bba64af admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:50.106595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa81593-d9ac-494a-9e5f-b10163e01e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:50.107203 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa81593-d9ac-494a-9e5f-b10163e01e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.107483 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa81593-d9ac-494a-9e5f-b10163e01e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.107759 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa81593-d9ac-494a-9e5f-b10163e01e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.108396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa81593-d9ac-494a-9e5f-b10163e01e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:50.110288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa81593-d9ac-494a-9e5f-b10163e01e0c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:50.121578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1189/2376] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:50.125625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:50.136224 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0ea7f-9976-4112-8343-0abaa625a6fd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:50.140888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:50.141532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.141955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.142229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] PATH_INFO: `/v3/projects/13a168b3c3d14157a53ab805e862829c/users/f4c16e3ebe074391912c6f667adde790/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.144195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a168b3c3d14157a53ab805e862829c, user_id=f4c16e3ebe074391912c6f667adde790, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:50.146872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:50.157530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1188/2377] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:50 2022] PUT /identity/v3/projects/13a168b3c3d14157a53ab805e862829c/users/f4c16e3ebe074391912c6f667adde790/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:50.168288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.171253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.171253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.198382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] MFA Rules not processed for user `f4c16e3ebe074391912c6f667adde790`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:50.199597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:50.274274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1190/2378] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:50.280319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:50.282577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:50.341781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64fa9e-0689-4ffc-839b-ef27f517d81a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:50.345751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fd728-23e7-45fb-a342-1b48ffe26d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:50.346364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd728-23e7-45fb-a342-1b48ffe26d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.346684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd728-23e7-45fb-a342-1b48ffe26d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.347022 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd728-23e7-45fb-a342-1b48ffe26d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.356703 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fd728-23e7-45fb-a342-1b48ffe26d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:50.358196 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fd728-23e7-45fb-a342-1b48ffe26d20 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:50.368565 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1189/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:50.507575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:50.574630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aecdb1-f46a-40e4-a275-6f77e70db526 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:50.579177 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:50.579955 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.580238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.580514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] PATH_INFO: `/v3/users/3df1363e67384a898cdb803109f9533b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.581711 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df1363e67384a898cdb803109f9533b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:50.583671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:50.586224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:50.702729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df1363e67384a898cdb803109f9533b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:50.703385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df1363e67384a898cdb803109f9533b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:50.715341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df1363e67384a898cdb803109f9533b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:50.769210 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df1363e67384a898cdb803109f9533b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:50.779576 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df1363e67384a898cdb803109f9533b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:50.787593 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1191/2380] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:50 2022] DELETE /identity/v3/users/3df1363e67384a898cdb803109f9533b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:50.792088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.792983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.793427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.817255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:50.817255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:50.881028 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1190/2381] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:50.890908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:50.892385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:50.953056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd1c95-564f-49d0-a52d-6606feb4704a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:50.956807 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:50.957413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:50.957733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:50.958009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:50.967183 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:50.968594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:50.978911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1192/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:51.548732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:51.550261 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:51.563011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168fe6-8145-4b9f-a52f-1de7a1ff809d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:51.567854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:51.568976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:51.568976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:51.569189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] PATH_INFO: `/v3/projects/246b9e9d2e734766953419dfba08f9ca` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:51.570231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246b9e9d2e734766953419dfba08f9ca)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:51.572148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:51.672665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246b9e9d2e734766953419dfba08f9ca', 'request_id': 'req-b7c565ee-cec0-4755-901d-141fa3827ef4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.674555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:51.679694 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246b9e9d2e734766953419dfba08f9ca', 'request_id': 'req-b7c565ee-cec0-4755-901d-141fa3827ef4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.729306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246b9e9d2e734766953419dfba08f9ca', 'request_id': 'req-b7c565ee-cec0-4755-901d-141fa3827ef4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.740804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] The token cache is being invalidate because project 246b9e9d2e734766953419dfba08f9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:51.741086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.741754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.743275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1191/2383] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:51 2022] DELETE /identity/v3/projects/246b9e9d2e734766953419dfba08f9ca => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:51.747312 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:51.757010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2927c-3765-44fd-9568-eb3ff234e600 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:51.812549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:51.813189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:51.813608 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:51.813885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] PATH_INFO: `/v3/users/f4c16e3ebe074391912c6f667adde790` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:51.814987 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c16e3ebe074391912c6f667adde790)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:51.816927 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:51.878253 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:51.954334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c16e3ebe074391912c6f667adde790'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.954931 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c16e3ebe074391912c6f667adde790'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:51.967971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c16e3ebe074391912c6f667adde790'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.020926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c16e3ebe074391912c6f667adde790'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.028471 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-14491323-2133-4ae3-a197-672a56b8c6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c16e3ebe074391912c6f667adde790'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.035090 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1193/2384] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:51 2022] DELETE /identity/v3/users/f4c16e3ebe074391912c6f667adde790 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:52.394464 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:52.397083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:52.411170 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c565ee-cec0-4755-901d-141fa3827ef4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:52.469586 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:52.469772 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:52.470055 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:52.470328 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] PATH_INFO: `/v3/projects/13a168b3c3d14157a53ab805e862829c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:52.471434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a168b3c3d14157a53ab805e862829c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:52.473372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:52.585334 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a168b3c3d14157a53ab805e862829c', 'request_id': 'req-93d2eb19-2f73-4aff-a795-5469c02eb722'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.591494 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a168b3c3d14157a53ab805e862829c', 'request_id': 'req-93d2eb19-2f73-4aff-a795-5469c02eb722'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.654353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a168b3c3d14157a53ab805e862829c', 'request_id': 'req-93d2eb19-2f73-4aff-a795-5469c02eb722'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.664869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] The token cache is being invalidate because project 13a168b3c3d14157a53ab805e862829c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:52.665151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.674455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-93d2eb19-2f73-4aff-a795-5469c02eb722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:52.674455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1192/2385] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:52 2022] DELETE /identity/v3/projects/13a168b3c3d14157a53ab805e862829c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:52.674659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:52.674659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:52.674659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:52.693074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:52.694297 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:52.750783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1194/2386] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:52.758919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:52.759206 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:52.759482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:52.778968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:52.780236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:52.787992 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1193/2387] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:52.792400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:52.802378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9efbf8-3014-494e-9385-10ede8a6d2f9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:52.806879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:52.807460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:52.807735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:52.808023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:52.808670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:53:52.808970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:52.810569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:52.822795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1195/2388] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:53:52.827005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:52.836143 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaab36-732f-4666-97ad-ce7f5cf7c48a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:52.840791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:52.841374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:52.841689 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:52.841964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:52.842603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:52.844545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:52.930767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1194/2389] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:52 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:52.935006 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:52.945708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049332e8-6424-4822-9328-caf9a32f91ba admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.002577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.003119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.003395 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.003692 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.004323 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.006258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.088801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1196/2390] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:52 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:53.092922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.103545 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ed458-43ea-47be-936f-741f96dcdf49 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.108062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.108902 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.109182 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.109452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.110114 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.111682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.122082 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1195/2391] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:53.125893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.135915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6329-0683-4e1b-ba0a-b23a5957e16f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.140776 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda24aa-8ca6-48c1-b5f3-88a53d3d9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.141346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda24aa-8ca6-48c1-b5f3-88a53d3d9610 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.141657 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda24aa-8ca6-48c1-b5f3-88a53d3d9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.141938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda24aa-8ca6-48c1-b5f3-88a53d3d9610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.142581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda24aa-8ca6-48c1-b5f3-88a53d3d9610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.144189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda24aa-8ca6-48c1-b5f3-88a53d3d9610 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.154653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1197/2392] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:53:53.158358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.168521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c5940-094d-40d2-9508-18ca6d2152ed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.173002 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.173656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.173933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.174201 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] PATH_INFO: `/v3/projects/c40dfdd7ee66493394fd2e4e41344be5/users/7ce0850c3d8b4ff7a9f5a0fd289e4f6c/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.189302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40dfdd7ee66493394fd2e4e41344be5, user_id=7ce0850c3d8b4ff7a9f5a0fd289e4f6c, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.191984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.289611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1196/2393] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:53 2022] PUT /identity/v3/projects/c40dfdd7ee66493394fd2e4e41344be5/users/7ce0850c3d8b4ff7a9f5a0fd289e4f6c/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:53.301288 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.301598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.301907 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.322309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:53.330614 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] MFA Rules not processed for user `7ce0850c3d8b4ff7a9f5a0fd289e4f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:53.332331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:53.395481 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1198/2394] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:53.400189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.409142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:53.463476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03152-c86a-4690-9c80-b58d9ad83251 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.468249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.468853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.469138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.469411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.470090 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.471982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.543272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1197/2395] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:53:53 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:53:53.547408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.558958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34bfd9-d259-42e0-926e-02cb8347994f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.631904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.632513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.632795 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.633064 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.633717 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.635600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.723663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1199/2396] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:53:53 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:53:53.727735 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.738381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be127c6-88d6-4c73-9c0d-ae86fd800421 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.743065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.743654 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.743934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.744205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.744883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.746503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.758410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1198/2397] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:53.762687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.774202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7923a-d49b-444b-8bdc-0c0533d1e869 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.778654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.779353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.779636 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.779942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] PATH_INFO: `/v3/projects/c65087407e68444e8ae285860562689c/users/c2154d917d61496692382e371952302c/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.795147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65087407e68444e8ae285860562689c, user_id=c2154d917d61496692382e371952302c, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.797838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.854751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1200/2398] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:53 2022] PUT /identity/v3/projects/c65087407e68444e8ae285860562689c/users/c2154d917d61496692382e371952302c/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:53:53.858953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.869012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d0a6b-e051-4489-a4ff-066bab20af33 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.924285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802ca25-469c-4afc-899a-c5bc4f7af88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.924879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ca25-469c-4afc-899a-c5bc4f7af88a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.925154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ca25-469c-4afc-899a-c5bc4f7af88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.925420 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ca25-469c-4afc-899a-c5bc4f7af88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.926072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ca25-469c-4afc-899a-c5bc4f7af88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.927644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ca25-469c-4afc-899a-c5bc4f7af88a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.937135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1199/2399] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:53:53.941809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:53.951892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130b16-b201-4db5-b27d-5ab32b499d53 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:53.956369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:53.957592 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.957869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.958134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] PATH_INFO: `/v3/projects/c65087407e68444e8ae285860562689c/users/c2154d917d61496692382e371952302c/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:53.960042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65087407e68444e8ae285860562689c, user_id=c2154d917d61496692382e371952302c, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:53.962682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:53.972663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1201/2400] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:53:53 2022] PUT /identity/v3/projects/c65087407e68444e8ae285860562689c/users/c2154d917d61496692382e371952302c/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:53.982682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:53.982966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:53.983241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:54.010897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] MFA Rules not processed for user `c2154d917d61496692382e371952302c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:54.012091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:54.078970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1200/2401] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:53:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:54.090793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:54.092508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:54.149366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a13fd-c81c-444c-82dc-2d609ebefc58 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:54.153033 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:54.153682 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:54.153963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:54.154231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:54.158371 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:54.211357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:54.213152 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:54.225647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1202/2402] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:59.175290 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:59.177264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:59.184970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:59.190461 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079205e8-a3e1-48d8-91c9-93fe780feb3c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:59.194010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118956-6803-4f10-9e19-a30a61b440bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:59.194599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118956-6803-4f10-9e19-a30a61b440bd service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:59.194876 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118956-6803-4f10-9e19-a30a61b440bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:59.195147 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118956-6803-4f10-9e19-a30a61b440bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:59.204315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118956-6803-4f10-9e19-a30a61b440bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:59.205754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118956-6803-4f10-9e19-a30a61b440bd service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:59.215372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1201/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:04.266476 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=25 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:05.001913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:05.064316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014630a4-aa03-4cd3-ba1b-54b1582f3f03 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:05.068791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:05.069413 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:05.069727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:05.070000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] PATH_INFO: `/v3/users/7ce0850c3d8b4ff7a9f5a0fd289e4f6c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:05.071141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce0850c3d8b4ff7a9f5a0fd289e4f6c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:05.073041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:05.229697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce0850c3d8b4ff7a9f5a0fd289e4f6c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:05.230540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce0850c3d8b4ff7a9f5a0fd289e4f6c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:05.243170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce0850c3d8b4ff7a9f5a0fd289e4f6c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:05.305622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce0850c3d8b4ff7a9f5a0fd289e4f6c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:05.313315 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce0850c3d8b4ff7a9f5a0fd289e4f6c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:05.319221 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1203/2404] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:05 2022] DELETE /identity/v3/users/7ce0850c3d8b4ff7a9f5a0fd289e4f6c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:54:05.323922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:05.324401 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:05.324509 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:05.343364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:05.344531 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:05.401831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1202/2405] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:54:05.412025 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:05.413388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:05.469518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28479e-48a8-4f38-b396-0e268d04bb03 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:05.473771 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:05.474373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:05.474652 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:05.474920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:05.484161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:05.485513 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:05.494893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1204/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:05.897165 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:05.898622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:05.910958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bd2f5-d807-4885-b025-451a1069e6fb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:05.915633 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:05.916264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:05.916694 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:05.916974 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] PATH_INFO: `/v3/projects/c40dfdd7ee66493394fd2e4e41344be5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:05.918139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40dfdd7ee66493394fd2e4e41344be5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:05.920076 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:06.043202 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40dfdd7ee66493394fd2e4e41344be5', 'request_id': 'req-b73a4978-4753-4921-a285-5fe44e11dee4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.049479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40dfdd7ee66493394fd2e4e41344be5', 'request_id': 'req-b73a4978-4753-4921-a285-5fe44e11dee4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.124007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40dfdd7ee66493394fd2e4e41344be5', 'request_id': 'req-b73a4978-4753-4921-a285-5fe44e11dee4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.135117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] The token cache is being invalidate because project c40dfdd7ee66493394fd2e4e41344be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:06.135407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.136015 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.137484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1203/2407] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:05 2022] DELETE /identity/v3/projects/c40dfdd7ee66493394fd2e4e41344be5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:06.141465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:06.150908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d753f-4bf8-48e6-ab12-1de77becd2bf service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:06.168138 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:06.205264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:06.205893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:06.206175 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:06.206447 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] PATH_INFO: `/v3/users/c2154d917d61496692382e371952302c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:06.207600 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2154d917d61496692382e371952302c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:06.209532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:06.416536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2154d917d61496692382e371952302c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.417193 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2154d917d61496692382e371952302c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.429671 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2154d917d61496692382e371952302c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.494448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2154d917d61496692382e371952302c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.501735 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3650624-2455-4433-924f-3ca78e0386ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2154d917d61496692382e371952302c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:06.507727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1205/2408] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:06 2022] DELETE /identity/v3/users/c2154d917d61496692382e371952302c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:06.890524 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:06.892043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:06.907407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4978-4753-4921-a285-5fe44e11dee4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:06.964306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:06.964853 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:06.965134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:06.965413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] PATH_INFO: `/v3/projects/c65087407e68444e8ae285860562689c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:06.966544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65087407e68444e8ae285860562689c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:06.968463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:06.984782 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:07.083981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65087407e68444e8ae285860562689c', 'request_id': 'req-f1c71c56-2000-4ca3-97de-b39952fa7dda'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:07.090356 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65087407e68444e8ae285860562689c', 'request_id': 'req-f1c71c56-2000-4ca3-97de-b39952fa7dda'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:07.157236 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65087407e68444e8ae285860562689c', 'request_id': 'req-f1c71c56-2000-4ca3-97de-b39952fa7dda'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:07.168200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] The token cache is being invalidate because project c65087407e68444e8ae285860562689c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:07.168483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:07.169091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f1c71c56-2000-4ca3-97de-b39952fa7dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:07.170591 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1204/2409] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:06 2022] DELETE /identity/v3/projects/c65087407e68444e8ae285860562689c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:07.176611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.176900 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.177191 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.197239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:07.198463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:07.257793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1206/2410] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:07.267231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.267517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.267787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.287846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:07.289027 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:07.296688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1205/2411] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:07.300756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.310240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76cb66-b0ee-4f24-ba33-1989eb96ddab None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:07.314678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:07.315258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.315550 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.315801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.316433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:54:07.317275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:07.318875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:07.330010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1207/2412] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:54:07.334836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.343888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f8bde-3c3e-49ad-8702-2546c9965530 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:07.348602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:07.349180 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.349455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.349759 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.350384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:07.352255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:07.444804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1206/2413] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:54:07 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:07.448912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.459731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad78d-0c76-4304-8b92-134e6f956a15 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:07.485744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:07.515109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:07.515703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.515981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.516335 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.516969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:07.519388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:07.643625 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1208/2414] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:54:07 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:07.647997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.658058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600502-39ca-4d77-8f00-fe198f927d77 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:07.665093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:07.665093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.665093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.665093 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.665477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:07.665898 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:07.675548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1207/2415] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:07.680010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.689803 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a6234-81c6-419a-87e5-201fb3f9acae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:07.695034 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7333c-8260-401a-b761-eb7748ac7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:07.695618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7333c-8260-401a-b761-eb7748ac7312 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.695898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7333c-8260-401a-b761-eb7748ac7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.696172 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7333c-8260-401a-b761-eb7748ac7312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.696801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7333c-8260-401a-b761-eb7748ac7312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:07.698410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7333c-8260-401a-b761-eb7748ac7312 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:07.708881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1209/2416] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:54:07.712927 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.722698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934e34-8855-4ae7-964a-a43dde210873 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:07.727217 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:07.727848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.728144 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.728397 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] PATH_INFO: `/v3/projects/d91e2f901b334fa287b13f2991b68872/users/5f516b9d885d47e19c7739217bda9c06/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.743320 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91e2f901b334fa287b13f2991b68872, user_id=5f516b9d885d47e19c7739217bda9c06, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:07.745914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:07.837402 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1208/2417] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:07 2022] PUT /identity/v3/projects/d91e2f901b334fa287b13f2991b68872/users/5f516b9d885d47e19c7739217bda9c06/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:07.848859 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:07.849140 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:07.849414 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:07.877145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] MFA Rules not processed for user `5f516b9d885d47e19c7739217bda9c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:07.878347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:07.942435 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1210/2418] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:07.976330 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:07.978043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:08.033919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c928-5813-4e28-a7ad-5bf64c5ff689 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:08.038039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed121-9d7f-4ca5-ae45-b0f4552bef3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:08.038630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed121-9d7f-4ca5-ae45-b0f4552bef3e service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:08.038905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed121-9d7f-4ca5-ae45-b0f4552bef3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:08.039172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed121-9d7f-4ca5-ae45-b0f4552bef3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:08.047275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ed121-9d7f-4ca5-ae45-b0f4552bef3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:08.048722 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ed121-9d7f-4ca5-ae45-b0f4552bef3e service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:08.057925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1209/2419] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:08.073563 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:08.134911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f3609-fc65-4aff-af80-f72bb613b3d7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:08.139394 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:08.140007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:08.140282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:08.140551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] PATH_INFO: `/v3/users/5f516b9d885d47e19c7739217bda9c06` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:08.141678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f516b9d885d47e19c7739217bda9c06)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:08.143568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:08.268416 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:08.274861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f516b9d885d47e19c7739217bda9c06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:08.275531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f516b9d885d47e19c7739217bda9c06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:08.287942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f516b9d885d47e19c7739217bda9c06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:08.334332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f516b9d885d47e19c7739217bda9c06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:08.341392 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f516b9d885d47e19c7739217bda9c06'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:08.347181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1211/2420] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:08 2022] DELETE /identity/v3/users/5f516b9d885d47e19c7739217bda9c06 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:08.352351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:08.352645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:08.352926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:08.371904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:08.373119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:08.410210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:08.430779 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1210/2421] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:08.440486 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:08.441911 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:08.498947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93699335-2b6f-49b6-a337-10964a9b737f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:08.502631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2fa87-dab4-4c68-9043-96f334e560e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:08.503254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fa87-dab4-4c68-9043-96f334e560e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:08.503530 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fa87-dab4-4c68-9043-96f334e560e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:08.503804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fa87-dab4-4c68-9043-96f334e560e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:08.512524 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2fa87-dab4-4c68-9043-96f334e560e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:08.513977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2fa87-dab4-4c68-9043-96f334e560e5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:08.523806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1212/2422] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:54:08.902532 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:08.904080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:08.916517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6619dc-30fe-479a-a453-34c290580604 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:08.921073 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:08.921753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:08.922033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:08.922303 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] PATH_INFO: `/v3/projects/d91e2f901b334fa287b13f2991b68872` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:08.923413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91e2f901b334fa287b13f2991b68872)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:08.925315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.071976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91e2f901b334fa287b13f2991b68872', 'request_id': 'req-d9eac117-680e-40e7-9750-d7941b3c83f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:09.078176 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91e2f901b334fa287b13f2991b68872', 'request_id': 'req-d9eac117-680e-40e7-9750-d7941b3c83f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:09.140210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91e2f901b334fa287b13f2991b68872', 'request_id': 'req-d9eac117-680e-40e7-9750-d7941b3c83f9'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:09.151294 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] The token cache is being invalidate because project d91e2f901b334fa287b13f2991b68872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:09.154502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:09.154502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d9eac117-680e-40e7-9750-d7941b3c83f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:09.154502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1211/2423] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:08 2022] DELETE /identity/v3/projects/d91e2f901b334fa287b13f2991b68872 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:09.158450 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.158738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.159013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.178856 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:09.183236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:09.241461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1213/2424] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:09.249265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.249580 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.249862 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.269848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:09.271049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:09.278900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1212/2425] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:09.282981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.292457 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3e28a-ef47-4f77-ab3c-2026f52327e7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.296952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.297534 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.297841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.298111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.298738 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:54:09.299038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.300594 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.312385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1214/2426] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:54:09.316508 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.326213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3130f1e-eedb-4b24-a1f0-4778a4729693 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.330749 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.331359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.331641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.331932 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.332570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.334510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.421232 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1213/2427] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:54:09 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:09.425561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.436076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c806-8184-493e-a79b-864e6e038ce3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.478336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:09.491356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.491946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.492225 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.492497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.493127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.495059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.615633 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1215/2428] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:54:09 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:09.621742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.631710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9c370-2f9a-4a0b-b7cf-aa83303d6ea6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.636354 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.636977 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.637257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.637527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.638189 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.639775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.649764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1214/2429] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:09.653718 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.664347 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8d1c8-8e4f-49f5-88b7-52f6cb7312fc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.669026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d9619-af33-434d-9381-e1aed4f11b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.669647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9619-af33-434d-9381-e1aed4f11b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.669930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9619-af33-434d-9381-e1aed4f11b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.670207 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d9619-af33-434d-9381-e1aed4f11b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.670840 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d9619-af33-434d-9381-e1aed4f11b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.672408 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d9619-af33-434d-9381-e1aed4f11b09 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.683577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1216/2430] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:09.687506 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.697453 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea63a8-17d7-44b8-b3aa-4729ab08b211 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.702001 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.702629 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.702905 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.703173 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] PATH_INFO: `/v3/projects/225dc3f7ebb44e269129ed53336a2a55/users/345bce1d7e89495aac231709e2fa50d4/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.717346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225dc3f7ebb44e269129ed53336a2a55, user_id=345bce1d7e89495aac231709e2fa50d4, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.719994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:09.762826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1215/2431] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:09 2022] PUT /identity/v3/projects/225dc3f7ebb44e269129ed53336a2a55/users/345bce1d7e89495aac231709e2fa50d4/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:54:09.827688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.828103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.828464 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.857819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] MFA Rules not processed for user `345bce1d7e89495aac231709e2fa50d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:09.859284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:09.922112 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1217/2432] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:09.926538 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:09.988152 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18b8f8-bcf3-42e7-8623-6d063b0fe357 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:09.992773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:09.993374 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:09.993688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:09.993960 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:09.994583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:09.996463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.001644 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:10.084178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1216/2433] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:54:09 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:10.088791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.099239 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918ee9f-6b0b-4b8e-8120-1ce40f2d7b5d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.155127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.155722 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.156001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.156274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.156889 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.158823 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.254921 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1218/2434] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:54:10 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:10.259353 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.269724 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9ccfa-b302-4776-83e0-3bf6b02e6d83 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.275075 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.275661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.275940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.276213 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.276997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.278662 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.288692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1217/2435] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:10.292866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.302993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427db48-53a4-4354-93f7-c2e17a81620e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.307695 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abf757-f81c-402c-aaba-ff28579df53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.312630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abf757-f81c-402c-aaba-ff28579df53c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.312630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abf757-f81c-402c-aaba-ff28579df53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.312630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abf757-f81c-402c-aaba-ff28579df53c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.312630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abf757-f81c-402c-aaba-ff28579df53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.312630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abf757-f81c-402c-aaba-ff28579df53c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.322282 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1219/2436] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:54:10.326364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.337095 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc66cf-ee56-4f27-a536-93adb55df610 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.341940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.342569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.342848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.343118 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] PATH_INFO: `/v3/projects/7216b23f60bb44a486c897ec20579f38/users/b85f69ec0793451a9bea7d9ec4a36e5e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.357520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7216b23f60bb44a486c897ec20579f38, user_id=b85f69ec0793451a9bea7d9ec4a36e5e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.360447 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.420065 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1218/2437] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:10 2022] PUT /identity/v3/projects/7216b23f60bb44a486c897ec20579f38/users/b85f69ec0793451a9bea7d9ec4a36e5e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:10.430357 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.430690 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.430969 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.459200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] MFA Rules not processed for user `b85f69ec0793451a9bea7d9ec4a36e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:10.461030 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:10.481763 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:10.525685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1220/2438] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:54:10.530422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.592327 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfda4-87d7-4e2a-8e81-8c131b6b37b0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.597126 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.597753 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.598035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.598307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.598933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.601407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.690376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1219/2439] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:54:10 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:10.694574 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.705084 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71cf55-1bc5-4785-9363-b66b1ee4cc2f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.761106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.761741 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.762021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.762313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.762929 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.764804 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.820087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1221/2440] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:54:10 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:10.824102 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.834366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b811a7-27ab-4c5e-8bd0-7feeaed72f0c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.839485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.840137 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.840415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.840687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.841324 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.842991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:10.854207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1220/2441] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:10.858263 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:10.868520 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f7c11-f61a-4985-8954-74b40fb1081a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:10.873220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:10.873898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:10.874230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:10.874505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] PATH_INFO: `/v3/projects/8671576148f543a9aa7df442698e34c3/users/1cfd1f4d4a094edb9847b5f498a37a2f/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:10.890186 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8671576148f543a9aa7df442698e34c3, user_id=1cfd1f4d4a094edb9847b5f498a37a2f, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:10.904506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:11.003261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1222/2442] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:10 2022] PUT /identity/v3/projects/8671576148f543a9aa7df442698e34c3/users/1cfd1f4d4a094edb9847b5f498a37a2f/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:11.007844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:11.017836 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe10e7-eef2-43e0-8081-846ef919e5b2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:11.072984 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb0fb-7c41-458d-9280-9bd7b2ce7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:11.073635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb0fb-7c41-458d-9280-9bd7b2ce7c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:11.073917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb0fb-7c41-458d-9280-9bd7b2ce7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:11.074188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb0fb-7c41-458d-9280-9bd7b2ce7c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:11.074814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fb0fb-7c41-458d-9280-9bd7b2ce7c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:11.076395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fb0fb-7c41-458d-9280-9bd7b2ce7c27 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:11.086619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1221/2443] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:11.090728 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:11.100901 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fe9bc-a3b1-4fd0-8cf2-8cbe25fa1bd3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:11.105460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:11.106128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:11.106411 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:11.106689 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] PATH_INFO: `/v3/projects/8671576148f543a9aa7df442698e34c3/users/1cfd1f4d4a094edb9847b5f498a37a2f/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:11.108851 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8671576148f543a9aa7df442698e34c3, user_id=1cfd1f4d4a094edb9847b5f498a37a2f, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:11.111546 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:11.121583 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1223/2444] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:11 2022] PUT /identity/v3/projects/8671576148f543a9aa7df442698e34c3/users/1cfd1f4d4a094edb9847b5f498a37a2f/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:11.131381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:11.132162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:11.132442 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:11.159777 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] MFA Rules not processed for user `1cfd1f4d4a094edb9847b5f498a37a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:11.160970 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:11.169924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:11.227885 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1222/2445] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:11.239732 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:11.241945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:11.297622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67eec9-2e6f-4b9d-9e02-fb8ee477a3ac admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:11.301145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:11.301757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:11.302036 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:11.302309 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:11.331733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:11.358470 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:11.360547 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:11.369914 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1224/2446] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:13.212292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:13.213638 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:13.231052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca333-0288-49af-8a2d-b45052bb3e13 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:13.234787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:13.235393 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:13.239794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:13.239794 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:13.292897 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:13.294359 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:13.303104 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1223/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:14.717567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:14.726218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d9208-442d-4478-8f49-d3dbc897a62f service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:14.729909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3656a7-bdd1-4a58-9a32-69148866714d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:14.730503 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3656a7-bdd1-4a58-9a32-69148866714d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:14.732017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3656a7-bdd1-4a58-9a32-69148866714d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:14.732017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3656a7-bdd1-4a58-9a32-69148866714d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:14.740142 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3656a7-bdd1-4a58-9a32-69148866714d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:14.741582 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3656a7-bdd1-4a58-9a32-69148866714d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:14.750999 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1225/2448] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:19.175005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:19.237391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e022a-46d8-4f1f-a1d7-7f9081bee18b service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:19.241919 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:19.242544 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:19.242823 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:19.243096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] PATH_INFO: `/v3/users/345bce1d7e89495aac231709e2fa50d4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:19.244205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345bce1d7e89495aac231709e2fa50d4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:19.246146 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:19.393761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345bce1d7e89495aac231709e2fa50d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:19.394416 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345bce1d7e89495aac231709e2fa50d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:19.395517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:19.414138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345bce1d7e89495aac231709e2fa50d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:19.414138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345bce1d7e89495aac231709e2fa50d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:19.414892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345bce1d7e89495aac231709e2fa50d4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:19.477339 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1224/2449] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:19 2022] DELETE /identity/v3/users/345bce1d7e89495aac231709e2fa50d4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:19.481860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:19.482328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:19.482526 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:19.501928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:19.503119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:19.561042 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1226/2450] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:19.570922 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:19.572996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:19.630018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489976-fb65-4dca-b379-f49e674a9449 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:19.633667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:19.634265 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:19.634542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:19.635336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:19.644298 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:19.645742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:19.655040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1225/2451] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:20.004937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:20.006445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:20.020816 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8464-58bc-4c7f-8714-03c90983b7cb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:20.025564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:20.026521 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:20.026731 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:20.026989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] PATH_INFO: `/v3/projects/225dc3f7ebb44e269129ed53336a2a55` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:20.028343 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] RBAC: Authorizing `identity:delete_project(project_id=225dc3f7ebb44e269129ed53336a2a55)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:20.030340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:20.112365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225dc3f7ebb44e269129ed53336a2a55', 'request_id': 'req-525bf8d1-6f84-4d52-9026-bebd3e42454c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.118610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225dc3f7ebb44e269129ed53336a2a55', 'request_id': 'req-525bf8d1-6f84-4d52-9026-bebd3e42454c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.157589 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225dc3f7ebb44e269129ed53336a2a55', 'request_id': 'req-525bf8d1-6f84-4d52-9026-bebd3e42454c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.168483 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] The token cache is being invalidate because project 225dc3f7ebb44e269129ed53336a2a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:20.168750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.169373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.171220 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1227/2452] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:20 2022] DELETE /identity/v3/projects/225dc3f7ebb44e269129ed53336a2a55 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:20.174971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:20.184623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0616-26c0-43e2-bbf9-2aa8bdab96a7 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:20.242017 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:20.242640 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:20.242918 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:20.243188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] PATH_INFO: `/v3/users/b85f69ec0793451a9bea7d9ec4a36e5e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:20.244289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85f69ec0793451a9bea7d9ec4a36e5e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:20.246238 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:20.485958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85f69ec0793451a9bea7d9ec4a36e5e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.486635 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85f69ec0793451a9bea7d9ec4a36e5e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.498873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85f69ec0793451a9bea7d9ec4a36e5e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.503352 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:20.506237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85f69ec0793451a9bea7d9ec4a36e5e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.506879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85f69ec0793451a9bea7d9ec4a36e5e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:20.580438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1226/2453] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:20 2022] DELETE /identity/v3/users/b85f69ec0793451a9bea7d9ec4a36e5e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:20.947206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:20.953654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:20.961815 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf8d1-6f84-4d52-9026-bebd3e42454c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:21.001294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:21.018822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:21.019452 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:21.019733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:21.020007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] PATH_INFO: `/v3/projects/7216b23f60bb44a486c897ec20579f38` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:21.021149 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7216b23f60bb44a486c897ec20579f38)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:21.023110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:21.127694 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7216b23f60bb44a486c897ec20579f38', 'request_id': 'req-15562986-dc35-40c7-8462-96d31aadf3e2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.134119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7216b23f60bb44a486c897ec20579f38', 'request_id': 'req-15562986-dc35-40c7-8462-96d31aadf3e2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.220567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7216b23f60bb44a486c897ec20579f38', 'request_id': 'req-15562986-dc35-40c7-8462-96d31aadf3e2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.235554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] The token cache is being invalidate because project 7216b23f60bb44a486c897ec20579f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:21.235554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.235554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.235554 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1228/2454] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:20 2022] DELETE /identity/v3/projects/7216b23f60bb44a486c897ec20579f38 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:21.238771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:21.240162 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:21.252599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e029e6-acc3-4f8b-bbd9-e30c6f8ddd8f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:21.306529 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:21.307134 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:21.307412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:21.307683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] PATH_INFO: `/v3/users/1cfd1f4d4a094edb9847b5f498a37a2f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:21.308769 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfd1f4d4a094edb9847b5f498a37a2f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:21.310690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:21.485631 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfd1f4d4a094edb9847b5f498a37a2f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.486227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfd1f4d4a094edb9847b5f498a37a2f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.498323 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfd1f4d4a094edb9847b5f498a37a2f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.505041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfd1f4d4a094edb9847b5f498a37a2f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.505704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d5a655bf-f778-40b6-bccb-da956dba91ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfd1f4d4a094edb9847b5f498a37a2f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:21.568482 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1227/2455] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:21 2022] DELETE /identity/v3/users/1cfd1f4d4a094edb9847b5f498a37a2f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:22.010961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.012418 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:22.026516 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15562986-dc35-40c7-8462-96d31aadf3e2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.082947 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.083577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.083860 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.084137 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] PATH_INFO: `/v3/projects/8671576148f543a9aa7df442698e34c3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.085250 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8671576148f543a9aa7df442698e34c3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.087194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.168287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8671576148f543a9aa7df442698e34c3', 'request_id': 'req-ce268c1e-3b29-4c7a-8830-12412b7e19df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:22.174940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8671576148f543a9aa7df442698e34c3', 'request_id': 'req-ce268c1e-3b29-4c7a-8830-12412b7e19df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:22.259957 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8671576148f543a9aa7df442698e34c3', 'request_id': 'req-ce268c1e-3b29-4c7a-8830-12412b7e19df'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:22.267385 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:22.271115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] The token cache is being invalidate because project 8671576148f543a9aa7df442698e34c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:22.274863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:22.274863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ce268c1e-3b29-4c7a-8830-12412b7e19df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:22.274863 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1229/2456] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:22 2022] DELETE /identity/v3/projects/8671576148f543a9aa7df442698e34c3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:22.278548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.279019 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.279166 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.299603 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:22.303670 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:22.359879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1228/2457] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:22.367653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.367940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.368219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.387913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:22.389134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:22.397190 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1230/2458] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:22.401459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.411728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba323e-b280-4a11-847c-692d62576b30 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.416384 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.416978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.417263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.417555 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.418255 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:54:22.418548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.420760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.422260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:22.432833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1229/2459] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:54:22.437189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.446334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe90a4-d863-434f-aee5-41c436e3e2c2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.450985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.451573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.451854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.452127 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.452854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.454754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.582066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1231/2460] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:54:22 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:22.586223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.597021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a4a16-78c2-4c90-969c-3fc945195611 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.652010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.652607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.652887 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.653746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.654369 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.656268 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.711630 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1230/2461] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:54:22 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:22.716293 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.726569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1582c-e532-42f9-91c0-30d8498011d4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.731325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.731953 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.732232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.732505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.733147 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.735029 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.744882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1232/2462] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:22.748747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.758528 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9e87-fc49-4e74-b8c6-9baa387f6f70 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.763668 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20be5-1803-469a-91dc-404c001b1425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.764259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20be5-1803-469a-91dc-404c001b1425 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.764540 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20be5-1803-469a-91dc-404c001b1425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.764813 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20be5-1803-469a-91dc-404c001b1425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.765446 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20be5-1803-469a-91dc-404c001b1425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.767068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20be5-1803-469a-91dc-404c001b1425 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.777845 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1231/2463] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:22.782529 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:22.792436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43d1e1-f804-4728-af30-4820b8e69cd7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:22.796988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:22.797662 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.797943 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.798216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] PATH_INFO: `/v3/projects/10dd303f354d4f47a7a9d8976017660b/users/6599aff470554223a27b2add33fb69cd/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.812332 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10dd303f354d4f47a7a9d8976017660b, user_id=6599aff470554223a27b2add33fb69cd, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:22.814981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:22.889793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1233/2464] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:22 2022] PUT /identity/v3/projects/10dd303f354d4f47a7a9d8976017660b/users/6599aff470554223a27b2add33fb69cd/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:22.899982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:22.900270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:22.900560 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:22.929957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] MFA Rules not processed for user `6599aff470554223a27b2add33fb69cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:22.931205 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:22.995136 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1232/2465] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:23.006581 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:23.008284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:23.064635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc33e-ad61-4dd9-8325-e06bd49b17d7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:23.068329 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:23.068928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:23.069209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:23.069484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:23.078339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:23.079752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:23.088468 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1234/2466] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:23.348426 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:23.349859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:23.406843 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb6818-7173-4ee2-a184-84cddf8f4427 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:23.410515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:23.410993 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:23.411271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:23.411543 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:23.413454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:23.423266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:23.424678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916818a-598c-48d3-b22f-27c00efee8f0 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:23.433092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1233/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:26.074218 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:26.134491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520e4cc-b48e-4488-87fc-c2b228ff7929 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:26.138882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:26.139485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:26.139761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:26.140031 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] PATH_INFO: `/v3/users/6599aff470554223a27b2add33fb69cd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:26.141115 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6599aff470554223a27b2add33fb69cd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:26.143026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:26.280792 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:26.285925 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6599aff470554223a27b2add33fb69cd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:26.286568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6599aff470554223a27b2add33fb69cd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:26.298174 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6599aff470554223a27b2add33fb69cd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:26.345895 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6599aff470554223a27b2add33fb69cd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:26.353232 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6599aff470554223a27b2add33fb69cd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:26.359443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1235/2468] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:26 2022] DELETE /identity/v3/users/6599aff470554223a27b2add33fb69cd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:26.363901 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:26.364449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:26.364449 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:26.372975 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:26.383497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:26.384741 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:26.441810 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1234/2469] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:26.452118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:26.453479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:26.510683 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea8e8d-7de9-42f6-bd58-8c76be3ed749 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:26.514410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87a1be-6369-41d3-b5da-adf38e73fa06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:26.515001 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87a1be-6369-41d3-b5da-adf38e73fa06 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:26.515281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87a1be-6369-41d3-b5da-adf38e73fa06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:26.515561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87a1be-6369-41d3-b5da-adf38e73fa06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:26.524373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87a1be-6369-41d3-b5da-adf38e73fa06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:26.525810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87a1be-6369-41d3-b5da-adf38e73fa06 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:26.535013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1236/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:26.948263 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:26.949792 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:26.963077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50d9d9-45e3-4835-bbeb-c9c33e87da88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:26.968386 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:26.969014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:26.969326 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:26.969704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] PATH_INFO: `/v3/projects/10dd303f354d4f47a7a9d8976017660b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:26.970841 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10dd303f354d4f47a7a9d8976017660b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:26.972726 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.054692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10dd303f354d4f47a7a9d8976017660b', 'request_id': 'req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:27.061056 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10dd303f354d4f47a7a9d8976017660b', 'request_id': 'req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:27.100082 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10dd303f354d4f47a7a9d8976017660b', 'request_id': 'req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:27.111408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] The token cache is being invalidate because project 10dd303f354d4f47a7a9d8976017660b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:27.111693 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:27.112309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-eefa86d4-c67c-455f-ab16-9cfaa1909cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:27.113900 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1235/2471] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:26 2022] DELETE /identity/v3/projects/10dd303f354d4f47a7a9d8976017660b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:27.118715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.119219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.119350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.140399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:27.141637 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:27.199113 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1237/2472] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:27.208199 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.208485 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.208751 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.229477 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:27.230711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:27.239370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1236/2473] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:27.243590 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.253787 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7747a96-9efb-4a94-88a6-375daad1bd33 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.258366 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.258970 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.259246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.259515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.260155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:54:27.260459 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.262068 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.273485 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1238/2474] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 07:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:54:27.277535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.286757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0917a-5812-4592-8ea3-cd377ca90ad0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.291390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.291979 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.292258 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.292527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.293151 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.295612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.359175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1237/2475] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 07:54:27 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:27.363333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.373910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05652cf3-107c-4660-b360-21ea41ea9850 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.417206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:27.429377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.430003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.430284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.430562 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.431187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.433082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.506163 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1239/2476] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 07:54:27 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:54:27.510184 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.520422 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15449819-a3ed-40fa-8b18-95c62e8cada4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.525058 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.525685 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.525964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.526237 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.526944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.528480 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.538513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1238/2477] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:27.542131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.554074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f736ea7-4b41-4115-8485-e4949a995ad5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.559017 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75184ce9-4e2c-4c6f-bcaf-fc32ad801265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.560286 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184ce9-4e2c-4c6f-bcaf-fc32ad801265 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.560801 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184ce9-4e2c-4c6f-bcaf-fc32ad801265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.561134 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184ce9-4e2c-4c6f-bcaf-fc32ad801265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.561956 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75184ce9-4e2c-4c6f-bcaf-fc32ad801265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.563536 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75184ce9-4e2c-4c6f-bcaf-fc32ad801265 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.575909 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1240/2478] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 07:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:54:27.580119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.590995 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096e90-ca1f-47a4-b4d9-ba17afc430c2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.596500 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.597153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.597434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.597746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] PATH_INFO: `/v3/projects/cd6a5ba834a248b89ae35ad40148ee14/users/fd0cfb025e244d1b86098e76f8a51154/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.613956 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6a5ba834a248b89ae35ad40148ee14, user_id=fd0cfb025e244d1b86098e76f8a51154, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.616754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.683589 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1239/2479] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 07:54:27 2022] PUT /identity/v3/projects/cd6a5ba834a248b89ae35ad40148ee14/users/fd0cfb025e244d1b86098e76f8a51154/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:27.694509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9671e65-af3f-4c22-a762-0f6001fead08 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.695058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9671e65-af3f-4c22-a762-0f6001fead08 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.695410 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9671e65-af3f-4c22-a762-0f6001fead08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.724508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f9671e65-af3f-4c22-a762-0f6001fead08 None None] MFA Rules not processed for user `fd0cfb025e244d1b86098e76f8a51154`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:27.725777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f9671e65-af3f-4c22-a762-0f6001fead08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:27.803607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1241/2480] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:27.818164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:27.821840 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:27.853880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:27.883511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d48e9-3d59-4674-a0a6-9c43bdc87081 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:27.888385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:27.888988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:27.889396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:27.889708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:27.898074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:27.899558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:27.908116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1240/2481] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:29.697415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:29.697968 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:29.698087 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:29.717649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] MFA Rules not processed for user `fd0cfb025e244d1b86098e76f8a51154`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:29.718846 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:29.725928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1242/2482] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:30.235372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:30.236825 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:30.315572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443647d9-f7bc-4125-b2ea-cd2d3eaa3cbe service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:30.320622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:30.321254 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:30.321533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:30.321834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:30.329619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:30.334838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:30.336437 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f433c-2dd7-4544-a670-1d7decc1fe58 service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:30.346475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1241/2483] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:34.610906 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:34.612313 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:34.691821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef9e92-6c6f-438d-b4d1-69af4293048e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:34.697465 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:34.698162 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:34.698560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:34.698854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:34.700607 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:34.713173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:34.714767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:34.726522 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1243/2484] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:40.342275 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=47 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:44.721146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:47.150502 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccab51-2bbb-4298-80c5-359a6d40679a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:47.150950 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccab51-2bbb-4298-80c5-359a6d40679a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:47.151042 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccab51-2bbb-4298-80c5-359a6d40679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:47.200424 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-82ccab51-2bbb-4298-80c5-359a6d40679a None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:47.201642 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82ccab51-2bbb-4298-80c5-359a6d40679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:47.265892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1242/2485] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:54:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:47.429398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:47.430849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:47.519479 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4bd62-12e1-4a03-9f65-4f6cf661cda5 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:47.524651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:47.525246 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:47.525525 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:47.525830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:47.533629 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:47.535185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:47.543131 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1244/2486] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:54:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:54:48.274030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6cf7-bc6f-44c2-b28a-dac5d4de8ee1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:48.274493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6cf7-bc6f-44c2-b28a-dac5d4de8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:48.274619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6cf7-bc6f-44c2-b28a-dac5d4de8ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:48.294510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f09e6cf7-bc6f-44c2-b28a-dac5d4de8ee1 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:48.296171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f09e6cf7-bc6f-44c2-b28a-dac5d4de8ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:48.303460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1243/2487] 10.222.0.26 () {58 vars in 967 bytes} [Wed Nov 2 07:54:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:48.316128 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:48.326391 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36587-c958-4437-b9cd-1484d3e79308 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:48.331750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:48.332397 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:48.332680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:48.332950 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:48.340716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:48.342294 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:48.350749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1245/2488] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:54:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:54:48.991583 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7b453-20a1-4215-a4b8-354bbda9bc1f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:48.991865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7b453-20a1-4215-a4b8-354bbda9bc1f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:48.992140 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7b453-20a1-4215-a4b8-354bbda9bc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:49.011304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5bd7b453-20a1-4215-a4b8-354bbda9bc1f None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:49.012479 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5bd7b453-20a1-4215-a4b8-354bbda9bc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:49.020209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1244/2489] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Nov 2 07:54:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:49.032436 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:49.043095 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335b60e-7581-425d-8b95-4235ea8209c3 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:49.048111 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:49.048700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:49.049648 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:49.049930 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:49.057821 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:49.059369 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:49.067291 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1246/2490] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:54:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:54:49.652788 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:49.653272 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:49.653366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:49.672011 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] MFA Rules not processed for user `659ffab6d37f4f1aaa7cc68bcfdcc041`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:49.673796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:49.680728 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1245/2491] 10.222.0.26 () {58 vars in 967 bytes} [Wed Nov 2 07:54:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:49.693181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:49.703509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf1944-867e-4201-9ece-c1abd50de836 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:49.708707 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822d2c-bd7d-4169-a42d-e7be182a9012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39f6ddafe58479a8dcf5161294a8b19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:49.709302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822d2c-bd7d-4169-a42d-e7be182a9012 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:49.709610 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822d2c-bd7d-4169-a42d-e7be182a9012 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:49.709886 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822d2c-bd7d-4169-a42d-e7be182a9012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:49.717898 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e822d2c-bd7d-4169-a42d-e7be182a9012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:49.719445 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e822d2c-bd7d-4169-a42d-e7be182a9012 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:49.727342 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1247/2492] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Nov 2 07:54:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:54:52.258337 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:52.320527 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14eda-d7df-4e9e-8ae7-cbff770b7339 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:52.325037 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:52.325687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:52.325969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:52.326249 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] PATH_INFO: `/v3/users/fd0cfb025e244d1b86098e76f8a51154` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:52.327370 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0cfb025e244d1b86098e76f8a51154)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:52.329368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:52.524826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0cfb025e244d1b86098e76f8a51154'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:52.525423 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0cfb025e244d1b86098e76f8a51154'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:52.530602 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:52.538005 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0cfb025e244d1b86098e76f8a51154'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:52.544796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0cfb025e244d1b86098e76f8a51154'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:52.545436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0cfb025e244d1b86098e76f8a51154'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:52.614266 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1246/2493] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:54:52 2022] DELETE /identity/v3/users/fd0cfb025e244d1b86098e76f8a51154 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:54:52.618700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:52.619206 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:52.619316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:52.637896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:52.639074 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:52.696353 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1248/2494] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:52.706542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:52.707968 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:52.764394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc74d9a-b86d-458c-bfae-a4efabf72eed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:52.768533 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:52.769133 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:52.769412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:52.769718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:52.778594 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:52.779946 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:52.789904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1247/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:54:53.056326 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:54:53.060805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:53.070328 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f1d3-54e5-40ed-9bd9-a1c08285fe4a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:54:53.074994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:54:53.075623 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:53.075903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:53.076217 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] PATH_INFO: `/v3/projects/cd6a5ba834a248b89ae35ad40148ee14` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:53.077334 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6a5ba834a248b89ae35ad40148ee14)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:54:53.079841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:54:53.164644 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:53.180216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6a5ba834a248b89ae35ad40148ee14', 'request_id': 'req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:53.186478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6a5ba834a248b89ae35ad40148ee14', 'request_id': 'req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:53.283230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6a5ba834a248b89ae35ad40148ee14', 'request_id': 'req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:53.294205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] The token cache is being invalidate because project cd6a5ba834a248b89ae35ad40148ee14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:54:53.294507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:53.295118 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:54:53.296595 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1249/2496] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:54:53 2022] DELETE /identity/v3/projects/cd6a5ba834a248b89ae35ad40148ee14 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:55:02.785707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=36,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:55:03.415219 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:55:17.923791 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:17.933314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210467f-122c-4e0d-a938-e66fddb4eb6d service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:17.983574 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:17.984252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:17.984708 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:17.984982 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:17.986913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:17.997221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:17.998667 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:18.006491 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1248/2497] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:55:18.077980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:18.079697 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:18.092874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3d9c4-dcd7-4a88-9095-91e0a8ec67d0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:18.104454 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:18.105082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:18.105360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:18.105678 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:18.114290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:18.208055 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:18.209604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366b97e-0378-4f22-8c8c-6d83ba7fb63e service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:18.220736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1250/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:55:19.914036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:19.917228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:19.933345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059104b5-ab94-4a9c-b533-84ac173bb2b1 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:19.938907 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:19.939450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:19.939730 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:19.940007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:19.941707 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:19.956664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:19.958379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:19.969944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1249/2499] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:55:22.273016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3cc47-4d50-4f24-97e5-77e260f8ee04 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:22.273501 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3cc47-4d50-4f24-97e5-77e260f8ee04 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:22.273638 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3cc47-4d50-4f24-97e5-77e260f8ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:22.292601 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-16d3cc47-4d50-4f24-97e5-77e260f8ee04 None None] MFA Rules not processed for user `b56ce65c523849fabfd7ee29249417f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:55:22.293811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-16d3cc47-4d50-4f24-97e5-77e260f8ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:22.349362 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1251/2500] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:55:22.654606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:22.663850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160091a-f84d-43ce-b640-6d72cb430348 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:22.667872 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:22.668454 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:22.668731 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:22.668997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:22.670729 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:22.679988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:22.682026 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:22.690043 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1250/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:55:32.342773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=59 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:55:32.686305 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=38 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:11.585951 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:11.586498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:11.586498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:11.606553 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] MFA Rules not processed for user `b56ce65c523849fabfd7ee29249417f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:57:11.607747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:11.614626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1252/2502] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:57:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:57:11.914542 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:11.923014 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314eed-8b9e-4af5-b7b0-468af2c9d5e3 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:11.926627 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:11.927212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:11.927493 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:11.927795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:11.929475 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:11.938750 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:11.940145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:11.947925 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1251/2503] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:12.131565 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:12.141568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58ced-33d9-4261-a954-6cb6a2212bb6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:12.145277 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:12.145904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:12.146200 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:12.146451 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:12.148181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:12.208449 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:12.209916 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:12.218975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1253/2504] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:14.562264 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:14.563760 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:14.636455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7958a90-bbfe-4cce-a5b5-442e108eb128 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:14.642467 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:14.643128 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:14.643411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:14.643682 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:14.645481 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:14.658159 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:14.661271 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:14.670576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1252/2505] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:57:18.640384 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:18.649116 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cccf9-fdf0-4726-8561-1e22f36bb9ad service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:18.653350 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:18.653994 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:18.654271 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:18.654541 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:18.656241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:18.717182 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:18.719736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:18.728145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1254/2506] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:22.331585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:22.342164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c24f6d-45eb-4a9d-b5ba-dbb25a689e7b service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:22.347221 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:22.347816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:22.348097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:22.348371 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:22.350150 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:22.362859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:22.364607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:22.375767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1253/2507] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:26.339104 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:26.341261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:26.353966 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d742c-7af0-40f2-817e-4947e029ed32 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:26.360820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:26.360820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:26.360820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:26.360820 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] PATH_INFO: `/v3/users/0588950a2ade4cc4916ed9f024e26b3d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:26.361208 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0588950a2ade4cc4916ed9f024e26b3d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:26.362962 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:26.545715 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0588950a2ade4cc4916ed9f024e26b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:26.546945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0588950a2ade4cc4916ed9f024e26b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:26.560216 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0588950a2ade4cc4916ed9f024e26b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:26.619000 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0588950a2ade4cc4916ed9f024e26b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:26.627466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0588950a2ade4cc4916ed9f024e26b3d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:26.629080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:26.634318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1255/2508] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:57:26 2022] DELETE /identity/v3/users/0588950a2ade4cc4916ed9f024e26b3d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:57:26.951342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:26.985338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552944-0bbf-4e91-9700-92c389099ca6 service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:27.045315 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:27.045839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:27.046124 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:27.046406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] PATH_INFO: `/v3/projects/460bf30d1ba14df5988c181e0df91b25` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:27.047547 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460bf30d1ba14df5988c181e0df91b25)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:27.049579 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:27.155911 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460bf30d1ba14df5988c181e0df91b25', 'request_id': 'req-82cfb2ba-c59a-4bad-be82-c450616d5382'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.162097 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460bf30d1ba14df5988c181e0df91b25', 'request_id': 'req-82cfb2ba-c59a-4bad-be82-c450616d5382'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.246764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460bf30d1ba14df5988c181e0df91b25', 'request_id': 'req-82cfb2ba-c59a-4bad-be82-c450616d5382'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.251135 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:27.258342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] The token cache is being invalidate because project 460bf30d1ba14df5988c181e0df91b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:57:27.258805 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.259406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.260860 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1254/2509] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:57:26 2022] DELETE /identity/v3/projects/460bf30d1ba14df5988c181e0df91b25 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:57:27.264861 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:27.266333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:27.279793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927c874-4439-4767-9eda-982787f2e23d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:27.338743 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:27.339885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:27.340461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:27.340461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] PATH_INFO: `/v3/users/78ced34e3fa64f04b442b7013b78db46` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:27.341564 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ced34e3fa64f04b442b7013b78db46)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:27.343477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:27.551480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ced34e3fa64f04b442b7013b78db46'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.552050 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ced34e3fa64f04b442b7013b78db46'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.563926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ced34e3fa64f04b442b7013b78db46'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.646540 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ced34e3fa64f04b442b7013b78db46'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.654181 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ced34e3fa64f04b442b7013b78db46'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:27.660439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1256/2510] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 07:57:27 2022] DELETE /identity/v3/users/78ced34e3fa64f04b442b7013b78db46 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:57:27.915088 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:27.916715 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:27.930131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfb2ba-c59a-4bad-be82-c450616d5382 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:27.985655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:27.986281 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:27.986562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:27.986835 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] PATH_INFO: `/v3/projects/324e2a48cb194dd3bab0b42feaeb29da` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:27.987941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324e2a48cb194dd3bab0b42feaeb29da)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:27.989865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:28.111172 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324e2a48cb194dd3bab0b42feaeb29da', 'request_id': 'req-f65dc8e6-45d7-40ae-9ef0-bd58721db653'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:28.117499 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324e2a48cb194dd3bab0b42feaeb29da', 'request_id': 'req-f65dc8e6-45d7-40ae-9ef0-bd58721db653'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:28.195307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324e2a48cb194dd3bab0b42feaeb29da', 'request_id': 'req-f65dc8e6-45d7-40ae-9ef0-bd58721db653'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:28.206582 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] The token cache is being invalidate because project 324e2a48cb194dd3bab0b42feaeb29da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:57:28.206870 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:28.207526 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:28.215830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1255/2511] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 07:57:27 2022] DELETE /identity/v3/projects/324e2a48cb194dd3bab0b42feaeb29da => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:57:29.662577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:29.662577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:29.737790 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c731-1d3a-4aec-b0f2-33170a040a2b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:29.749819 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:29.803097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:29.803621 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:29.803896 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:29.804167 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:29.806011 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:29.817897 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:29.822622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:29.831396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1257/2512] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:38.203379 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:39.887659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=27 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:44.544883 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:44.546414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:44.562006 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dc8e6-45d7-40ae-9ef0-bd58721db653 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:44.567884 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:44.568468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:44.568742 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:44.569012 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:44.570684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:44.630516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:44.632121 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:44.641123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1256/2513] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:46.284062 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:46.285631 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:46.341432 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe96c-6b3b-4d4e-95b6-af8995f27fe6 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:46.344980 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:46.345596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:46.345875 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:46.346145 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:46.347817 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:46.360989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:46.362423 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253e299-a412-4eb2-87a0-c008057e2c2c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:46.373556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1258/2514] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:49.348972 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:49.350450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:49.362319 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56799f77-0ab7-41e4-9dbc-258a64ed3ef6 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:49.366411 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:49.366999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:49.367278 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:49.367548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:49.369203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:49.383314 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:49.384720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:49.395679 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1257/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:56.368976 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=26 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:59.390879 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=34 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:00.191920 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71913cb0-29d5-413a-865d-525461eee68b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:00.192425 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71913cb0-29d5-413a-865d-525461eee68b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:00.192533 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71913cb0-29d5-413a-865d-525461eee68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:00.211560 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-71913cb0-29d5-413a-865d-525461eee68b None None] MFA Rules not processed for user `b56ce65c523849fabfd7ee29249417f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:59:00.212747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-71913cb0-29d5-413a-865d-525461eee68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:00.219469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1259/2516] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 07:59:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:59:10.206188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:26.311486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:26.312913 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:26.368193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e017ac-66b0-4d05-9f23-34a7f5c6481c service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:26.371743 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:26.372368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:26.372646 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:26.372917 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:26.374612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:26.384657 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:26.386091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:26.393978 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1258/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 07:59:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:59:36.390458 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=26 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:41.406205 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71913cb0-29d5-413a-865d-525461eee68b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:41.408184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-71913cb0-29d5-413a-865d-525461eee68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:41.427484 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71913cb0-29d5-413a-865d-525461eee68b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:41.433775 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0297ece9087142c1987312d97a6a3867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:41.434389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:41.434669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:41.434942 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:41.436650 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:41.449388 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:41.451022 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:41.463106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1260/2518] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:00:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:00:48.135342 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:48.144441 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8a74-4ff5-43e5-b111-9f3ff3d10d84 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:48.147955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:48.148541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:48.148814 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:48.149079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:48.150785 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:48.211436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:48.212832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:48.222818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1259/2519] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:00:51.458318 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:51.835778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:51.837378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:51.852462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495e35-d56f-40e7-99d1-a8c3c971f016 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:51.856983 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:51.858240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:51.858240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:51.858240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] PATH_INFO: `/v3/users/b56ce65c523849fabfd7ee29249417f8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:51.859262 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56ce65c523849fabfd7ee29249417f8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:51.861164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:52.084352 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56ce65c523849fabfd7ee29249417f8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.085015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56ce65c523849fabfd7ee29249417f8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.097053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56ce65c523849fabfd7ee29249417f8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.166667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56ce65c523849fabfd7ee29249417f8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.173880 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d25b502a-1614-4444-b3d4-bb1dec747e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56ce65c523849fabfd7ee29249417f8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.179936 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1261/2520] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:00:51 2022] DELETE /identity/v3/users/b56ce65c523849fabfd7ee29249417f8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:52.414046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:52.424564 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992b96b-4fcb-4235-ad4a-728b0bb93737 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:52.482292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:52.483007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:52.483286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:52.483556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] PATH_INFO: `/v3/projects/067034b94cc1492797bd3f9c9b415137` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:52.484650 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067034b94cc1492797bd3f9c9b415137)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:52.487079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:52.603597 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067034b94cc1492797bd3f9c9b415137', 'request_id': 'req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.609830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067034b94cc1492797bd3f9c9b415137', 'request_id': 'req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.724372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067034b94cc1492797bd3f9c9b415137', 'request_id': 'req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.735711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] The token cache is being invalidate because project 067034b94cc1492797bd3f9c9b415137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:00:52.735999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.737259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dea6ad59-a8c7-4ae7-80e5-c5dcb42eef39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:52.738739 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1260/2521] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:00:52 2022] DELETE /identity/v3/projects/067034b94cc1492797bd3f9c9b415137 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:52.743885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:52.744409 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:52.744514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:52.764646 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:52.769368 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:52.822679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1262/2522] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:00:52.830409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:52.830696 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:52.830969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:52.851132 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:52.855007 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:52.860497 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1261/2523] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:00:52.865211 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:52.874704 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767fec-bbdc-4712-be8f-877a4266d9d3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:52.879240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:52.879890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:52.880169 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:52.880441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:52.881077 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 08:00:52.881376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:52.882991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:52.894310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1263/2524] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 08:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 08:00:52.898570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:52.907833 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992b925-91d7-4d29-8f88-72e8a619c35d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:52.912928 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:52.913516 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:52.913826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:52.914101 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:52.914771 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:52.916656 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:52.933080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:53.013999 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1262/2525] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:00:52 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:00:53.018165 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:53.028237 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb419d-e63a-4b9b-bd46-b5726ffa1073 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:53.084505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:53.085126 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:53.085405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:53.085703 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:53.086322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:53.088196 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:53.096653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:53.163902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1264/2526] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:00:53 2022] POST /identity/v3/users => generated 302 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:00:53.167804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:53.177988 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45cfe-e40c-4260-a0d5-e3fb1cae01d1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:53.182595 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:53.183183 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:53.183462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:53.183733 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:53.184362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:53.185983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:53.195757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1263/2527] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:00:53.199509 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:53.209902 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e79e-9a90-49a5-899b-8642da47406d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:53.214532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e792a3-0f4f-4888-a19f-931a1739edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:53.215123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e792a3-0f4f-4888-a19f-931a1739edba admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:53.215403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e792a3-0f4f-4888-a19f-931a1739edba admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:53.215679 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e792a3-0f4f-4888-a19f-931a1739edba admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:53.216316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e792a3-0f4f-4888-a19f-931a1739edba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:53.217926 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e792a3-0f4f-4888-a19f-931a1739edba admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:53.230005 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1265/2528] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:00:53.233624 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:53.243535 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61182b-22bd-4f7d-8fb1-dea79589a7e1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:53.248306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:53.248952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:53.249231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:53.249505 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] PATH_INFO: `/v3/projects/e83b26d127cc4006848a4d3605f71566/users/3dbfa50b5f4e40fbba2fc320c3d123da/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:53.263955 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83b26d127cc4006848a4d3605f71566, user_id=3dbfa50b5f4e40fbba2fc320c3d123da, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:53.266665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:53.338117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1264/2529] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:00:53 2022] PUT /identity/v3/projects/e83b26d127cc4006848a4d3605f71566/users/3dbfa50b5f4e40fbba2fc320c3d123da/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:53.343227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac48e3-8704-4194-a68b-6e4d35f96aba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:53.346549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac48e3-8704-4194-a68b-6e4d35f96aba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:53.346549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac48e3-8704-4194-a68b-6e4d35f96aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:53.363442 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3dac48e3-8704-4194-a68b-6e4d35f96aba None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:53.364622 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3dac48e3-8704-4194-a68b-6e4d35f96aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:53.420940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1266/2530] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:00:53.430434 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:53.432122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:53.488821 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295f329-79ca-4eb4-8663-f437db02fd00 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:53.492495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:53.493092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:53.493373 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:53.493686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:53.503096 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:53.504511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:53.513933 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1265/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:00:54.696041 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:54.696558 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:54.696766 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:54.727229 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] MFA Rules not processed for user `3dbfa50b5f4e40fbba2fc320c3d123da`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:54.728989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:54.794767 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1267/2532] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:00:54.799338 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:54.809195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d1256-b710-4e73-8539-9b5fd81f5dd7 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:54.814087 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:54.814781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:54.815064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:54.815336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:54.815985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:54.817934 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:54.901744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1266/2533] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:00:54 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:00:54.905938 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:54.917283 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352fd3b-f16a-4d46-8b77-87e653a12c3c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:54.972231 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:54.972830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:54.973109 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:54.973670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:54.974305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:54.976201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:55.044046 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:55.049802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1268/2534] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:00:54 2022] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:00:55.053882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:55.064018 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8356-0018-4139-b804-0a4c32573e1f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:55.069293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:55.069957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:55.070241 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:55.070514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:55.071175 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:55.072756 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:55.084030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1267/2535] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:00:55.092003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:55.102150 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3813bc-58f1-48b6-9084-7a815830d08c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:55.107269 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:55.107904 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:55.108180 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:55.108453 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] PATH_INFO: `/v3/projects/5180396169374b979b22a77a3cb46eed/users/13eaec191d9841a3b3fa969b795cac6b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:55.123667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5180396169374b979b22a77a3cb46eed, user_id=13eaec191d9841a3b3fa969b795cac6b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:55.126331 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:55.212381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1269/2536] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:00:55 2022] PUT /identity/v3/projects/5180396169374b979b22a77a3cb46eed/users/13eaec191d9841a3b3fa969b795cac6b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 08:00:55.216256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:55.226652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0cda-e4de-4614-ac73-16da10866cba admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:55.283692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f095eb4-f4d5-45cd-ac64-6ffa6a9cf9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:55.284287 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095eb4-f4d5-45cd-ac64-6ffa6a9cf9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:55.284562 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095eb4-f4d5-45cd-ac64-6ffa6a9cf9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:55.284830 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095eb4-f4d5-45cd-ac64-6ffa6a9cf9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:55.285450 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f095eb4-f4d5-45cd-ac64-6ffa6a9cf9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:55.287079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f095eb4-f4d5-45cd-ac64-6ffa6a9cf9e4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:55.296428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1268/2537] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:00:55.300687 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:55.310628 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb9708-e519-4347-ae18-40cee8f39bb8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:55.315626 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:55.316254 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:55.316528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:55.316796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] PATH_INFO: `/v3/projects/5180396169374b979b22a77a3cb46eed/users/13eaec191d9841a3b3fa969b795cac6b/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:55.318714 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5180396169374b979b22a77a3cb46eed, user_id=13eaec191d9841a3b3fa969b795cac6b, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:55.321296 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:55.331834 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1270/2538] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:00:55 2022] PUT /identity/v3/projects/5180396169374b979b22a77a3cb46eed/users/13eaec191d9841a3b3fa969b795cac6b/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 08:00:56.512636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:56.513117 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:56.513394 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:56.547302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] MFA Rules not processed for user `13eaec191d9841a3b3fa969b795cac6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:56.548795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:56.561593 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:56.622690 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1269/2539] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:00:57.178105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:57.179772 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:57.251551 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8726-5691-4553-8cb0-7fbcc3a5d4d9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:57.256757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:57.257360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:57.257668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:57.257940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:57.259654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:57.270791 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:57.272279 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:57.281873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1271/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:00:57.962796 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:58.024412 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252f4e-8b98-4ab7-8f95-30cb7dc093a6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:58.028965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:58.029610 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:58.029895 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:58.030171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] PATH_INFO: `/v3/users/3dbfa50b5f4e40fbba2fc320c3d123da` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:58.031309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbfa50b5f4e40fbba2fc320c3d123da)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:58.033748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:58.226131 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbfa50b5f4e40fbba2fc320c3d123da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.226710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbfa50b5f4e40fbba2fc320c3d123da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.239747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbfa50b5f4e40fbba2fc320c3d123da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.246510 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbfa50b5f4e40fbba2fc320c3d123da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.247168 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbfa50b5f4e40fbba2fc320c3d123da'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.340195 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1270/2541] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:00:57 2022] DELETE /identity/v3/users/3dbfa50b5f4e40fbba2fc320c3d123da => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:58.580058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:58.593161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e4ae-74a0-414a-8bfb-42d95e4c9963 service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:58.649822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:58.650440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:58.650719 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:58.650989 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] PATH_INFO: `/v3/projects/e83b26d127cc4006848a4d3605f71566` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:58.652080 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83b26d127cc4006848a4d3605f71566)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:58.654060 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:58.755708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83b26d127cc4006848a4d3605f71566', 'request_id': 'req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.757597 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:58.762027 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83b26d127cc4006848a4d3605f71566', 'request_id': 'req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.823981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83b26d127cc4006848a4d3605f71566', 'request_id': 'req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.834685 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] The token cache is being invalidate because project e83b26d127cc4006848a4d3605f71566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:00:58.834965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.835573 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:58.837063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1272/2542] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:00:58 2022] DELETE /identity/v3/projects/e83b26d127cc4006848a4d3605f71566 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:58.841181 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:58.842694 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:58.855875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b37cf9-14b2-4cdd-b58f-54c8e121a7db admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:58.884576 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:58.911781 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:58.912403 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:58.912678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:58.912953 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] PATH_INFO: `/v3/users/13eaec191d9841a3b3fa969b795cac6b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:58.914091 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13eaec191d9841a3b3fa969b795cac6b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:58.917267 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:59.109142 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13eaec191d9841a3b3fa969b795cac6b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.109822 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13eaec191d9841a3b3fa969b795cac6b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.122361 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13eaec191d9841a3b3fa969b795cac6b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.129929 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13eaec191d9841a3b3fa969b795cac6b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.132839 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35184d93-d8f8-42ef-9d2c-4e72b663bdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13eaec191d9841a3b3fa969b795cac6b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.220067 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1271/2543] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:00:58 2022] DELETE /identity/v3/users/13eaec191d9841a3b3fa969b795cac6b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:59.496403 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:59.497940 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:59.510783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bcc12-5c96-4d9b-a5b8-6de3c2cd8b6a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:59.566981 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:59.567604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:59.567913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:59.568188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] PATH_INFO: `/v3/projects/5180396169374b979b22a77a3cb46eed` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:59.569284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5180396169374b979b22a77a3cb46eed)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:59.571209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:59.689341 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5180396169374b979b22a77a3cb46eed', 'request_id': 'req-d5c49c9c-0740-4bec-a227-8d0ef30359b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.695549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5180396169374b979b22a77a3cb46eed', 'request_id': 'req-d5c49c9c-0740-4bec-a227-8d0ef30359b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.784160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5180396169374b979b22a77a3cb46eed', 'request_id': 'req-d5c49c9c-0740-4bec-a227-8d0ef30359b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.794866 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] The token cache is being invalidate because project 5180396169374b979b22a77a3cb46eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:00:59.795155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.795773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d5c49c9c-0740-4bec-a227-8d0ef30359b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:00:59.797270 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1273/2544] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:00:59 2022] DELETE /identity/v3/projects/5180396169374b979b22a77a3cb46eed => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:00:59.802863 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:59.803154 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:59.803428 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:59.822720 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:59.823906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:59.881818 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1272/2545] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 08:00:59.889793 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:59.890069 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:59.890346 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:59.910972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:00:59.912160 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:59.919871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1274/2546] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:00:59.924081 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:59.933746 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764666-58ff-4c5c-aeb0-7d1407099c1f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:59.938227 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:59.938817 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:59.939119 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:59.939391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:59.940034 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 08:00:59.940336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:59.941971 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:59.953391 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1273/2547] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 08:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 08:00:59.957890 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:59.966788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1065-913c-4c45-91e8-ca7e8c8c0d40 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:59.972575 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:59.973441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:59.973758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:59.974035 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:59.974670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:59.976611 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.107917 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1275/2548] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:00:59 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:00.111957 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.122010 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c5aa-831e-4ce9-b557-bc4e24d925d2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.155203 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:00.178473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.179072 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.179351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.179622 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.180252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.182228 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.264489 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1274/2549] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:00 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:00.269178 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.279497 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8ca09-146c-457f-b7ab-51c0e95490ac admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.284040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.284630 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.284908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.285252 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.285952 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.287532 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.297238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1276/2550] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 08:01:00.301209 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.311332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6f5fa-6885-40b8-87de-664ee1854ab7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.316495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd5c55-d1de-4936-b1c7-b35535ea3062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.317079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd5c55-d1de-4936-b1c7-b35535ea3062 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.317360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd5c55-d1de-4936-b1c7-b35535ea3062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.317661 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd5c55-d1de-4936-b1c7-b35535ea3062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.318295 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd5c55-d1de-4936-b1c7-b35535ea3062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.319874 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd5c55-d1de-4936-b1c7-b35535ea3062 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.330229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1275/2551] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:00.334224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.343967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13219c09-e7b2-4a67-b2b7-dd6278cc397e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.348757 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.349389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.349700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.349977 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] PATH_INFO: `/v3/projects/c46d4d18fad444ba98c069f474ea852c/users/a47d13c2f14f485d830f947d3c5fde9e/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.364155 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46d4d18fad444ba98c069f474ea852c, user_id=a47d13c2f14f485d830f947d3c5fde9e, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.366753 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.423398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1277/2552] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:00 2022] PUT /identity/v3/projects/c46d4d18fad444ba98c069f474ea852c/users/a47d13c2f14f485d830f947d3c5fde9e/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:00.433732 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.434360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.434360 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.462572 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] MFA Rules not processed for user `a47d13c2f14f485d830f947d3c5fde9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:00.463754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:00.526111 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1276/2553] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:00.530496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.539168 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:00.590322 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af450e2-9e23-45dc-bc1f-634696f11df3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.594850 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.595466 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.595744 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.596016 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.596645 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.599448 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.673097 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1278/2554] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:01:00 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:00.677851 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.688686 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d81f3-1d95-4bac-91ac-3639c700f9b8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.744418 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.745031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.745313 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.745625 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.746259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.748149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.837357 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1277/2555] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:00 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:00.841325 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.851882 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09bb07-84bb-439f-a467-9f262fa29b7a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.856421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.857002 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.857276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.857577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.858198 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.859822 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:00.870958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1279/2556] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:00.874816 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:00.885399 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2376-0d2c-43af-bf13-c944cca5b13d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:00.890335 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:00.890976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:00.891252 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:00.891523 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] PATH_INFO: `/v3/projects/78143559370a43568fa75a27d2e8a84f/users/5044d774f4f5494b874890b5296fcb51/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:00.907057 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=78143559370a43568fa75a27d2e8a84f, user_id=5044d774f4f5494b874890b5296fcb51, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:00.909718 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:01.015171 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1278/2557] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:00 2022] PUT /identity/v3/projects/78143559370a43568fa75a27d2e8a84f/users/5044d774f4f5494b874890b5296fcb51/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:01.019040 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:01.028979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466956-d6ce-42d9-817b-4f9ed027c6d6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:01.085251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724ff1-1cab-49a7-8e3f-92d019505744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:01.085874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724ff1-1cab-49a7-8e3f-92d019505744 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.086164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724ff1-1cab-49a7-8e3f-92d019505744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.086440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724ff1-1cab-49a7-8e3f-92d019505744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.087071 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724ff1-1cab-49a7-8e3f-92d019505744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:01.088654 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724ff1-1cab-49a7-8e3f-92d019505744 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:01.098988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1280/2558] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:01.103107 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:01.113804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989637dd-6b11-455b-aa80-9219c53b2bea admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:01.118406 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:01.119040 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.119317 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.119587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] PATH_INFO: `/v3/projects/78143559370a43568fa75a27d2e8a84f/users/5044d774f4f5494b874890b5296fcb51/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.121484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78143559370a43568fa75a27d2e8a84f, user_id=5044d774f4f5494b874890b5296fcb51, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:01.124092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:01.129444 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:01.134415 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1279/2559] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:01 2022] PUT /identity/v3/projects/78143559370a43568fa75a27d2e8a84f/users/5044d774f4f5494b874890b5296fcb51/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:01.200908 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.201188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.201462 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.230991 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] MFA Rules not processed for user `5044d774f4f5494b874890b5296fcb51`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:01.232209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:01.297984 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1281/2560] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:01.309351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:01.311046 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:01.367755 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c49d-4088-4767-a3ae-efbda9abdd2a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:01.371372 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7851f22-0e35-4155-8b90-af0e2c6dc1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:01.371961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7851f22-0e35-4155-8b90-af0e2c6dc1fd service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.372243 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7851f22-0e35-4155-8b90-af0e2c6dc1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.372517 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7851f22-0e35-4155-8b90-af0e2c6dc1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.381520 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7851f22-0e35-4155-8b90-af0e2c6dc1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:01.383039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7851f22-0e35-4155-8b90-af0e2c6dc1fd service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:01.392761 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1280/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:01.421236 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:01.425377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:01.481802 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd99e20-db17-4c74-919d-92ccba99b8d0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:01.486367 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:01.486975 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.487255 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.487571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] PATH_INFO: `/v3/users/a47d13c2f14f485d830f947d3c5fde9e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.488669 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47d13c2f14f485d830f947d3c5fde9e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:01.490598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:01.645508 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47d13c2f14f485d830f947d3c5fde9e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:01.646194 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47d13c2f14f485d830f947d3c5fde9e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:01.660003 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47d13c2f14f485d830f947d3c5fde9e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:01.723667 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47d13c2f14f485d830f947d3c5fde9e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:01.730830 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47d13c2f14f485d830f947d3c5fde9e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:01.736635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1282/2562] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:01:01 2022] DELETE /identity/v3/users/a47d13c2f14f485d830f947d3c5fde9e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:01.741153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.741436 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.741744 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.760669 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:01.761880 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:01.818842 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1281/2563] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:01.828511 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:01.830463 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:01.885912 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5763f9c-ecb3-4fad-a00c-bd08dde12ed6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:01.889605 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:01.890202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:01.890482 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:01.890756 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:01.900373 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:01.901724 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:01.910993 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1283/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:02.327948 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:02.335598 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:02.341530 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94aff5-c23a-432f-80f8-c27f1bef74e7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:02.346289 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:02.346916 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:02.347191 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:02.347465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] PATH_INFO: `/v3/projects/c46d4d18fad444ba98c069f474ea852c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:02.348844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46d4d18fad444ba98c069f474ea852c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:02.350747 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:02.457584 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46d4d18fad444ba98c069f474ea852c', 'request_id': 'req-2402bfc7-77f0-45e6-8a10-7db36584c25e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.463678 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46d4d18fad444ba98c069f474ea852c', 'request_id': 'req-2402bfc7-77f0-45e6-8a10-7db36584c25e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.531926 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46d4d18fad444ba98c069f474ea852c', 'request_id': 'req-2402bfc7-77f0-45e6-8a10-7db36584c25e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.542698 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] The token cache is being invalidate because project c46d4d18fad444ba98c069f474ea852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:01:02.542981 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.543592 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.545074 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1282/2565] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:01:02 2022] DELETE /identity/v3/projects/c46d4d18fad444ba98c069f474ea852c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:02.549729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:02.559292 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daed33b-b1e2-4e42-abb0-d111fbd77aca service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:02.578469 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:02.615187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:02.615838 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:02.616123 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:02.616400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] PATH_INFO: `/v3/users/5044d774f4f5494b874890b5296fcb51` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:02.617515 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5044d774f4f5494b874890b5296fcb51)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:02.619506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:02.759506 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5044d774f4f5494b874890b5296fcb51'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.760076 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5044d774f4f5494b874890b5296fcb51'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.772021 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5044d774f4f5494b874890b5296fcb51'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.843281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5044d774f4f5494b874890b5296fcb51'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.851201 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5ec87b1f-398d-43d3-bc2f-6e34e70637c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5044d774f4f5494b874890b5296fcb51'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:02.857091 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1284/2566] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:01:02 2022] DELETE /identity/v3/users/5044d774f4f5494b874890b5296fcb51 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:03.268820 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:03.270277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:03.284346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402bfc7-77f0-45e6-8a10-7db36584c25e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:03.306129 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:03.342141 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:03.342804 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:03.343079 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:03.343346 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] PATH_INFO: `/v3/projects/78143559370a43568fa75a27d2e8a84f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:03.344452 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78143559370a43568fa75a27d2e8a84f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:03.346473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:03.482556 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78143559370a43568fa75a27d2e8a84f', 'request_id': 'req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:03.488848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78143559370a43568fa75a27d2e8a84f', 'request_id': 'req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:03.583270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78143559370a43568fa75a27d2e8a84f', 'request_id': 'req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:03.594861 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] The token cache is being invalidate because project 78143559370a43568fa75a27d2e8a84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:01:03.595188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:03.595838 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a36cec3-0fa2-4e8f-aaeb-d86352306e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:03.597302 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1283/2567] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:01:03 2022] DELETE /identity/v3/projects/78143559370a43568fa75a27d2e8a84f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:03.602518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:03.603007 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:03.603107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:03.622958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:03.624142 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:03.681374 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1285/2568] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:03.689569 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:03.689852 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:03.690153 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:03.709169 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:03.710382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:03.718116 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1284/2569] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:03.722302 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:03.732153 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbddc7-7da2-4d8a-99ae-f337f1948aed None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:03.737161 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:03.737778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:03.738059 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:03.738333 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:03.738972 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 08:01:03.739275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:03.740852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:03.752960 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1286/2570] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 08:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 08:01:03.757064 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:03.766242 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26192a3-d521-4411-b1b7-85104b00afef None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:03.770797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:03.771376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:03.771652 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:03.771923 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:03.772548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:03.774459 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:03.895548 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1285/2571] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:01:03 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:03.899674 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:03.909794 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fde67-9bbb-4bd1-886e-bdb06709aa99 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:03.938372 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:03.965827 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:03.966422 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:03.966700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:03.966971 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:03.967609 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:03.969903 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.042777 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1287/2572] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:03 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:04.047062 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.058148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510e0a-5baa-4ab7-a669-9a7481c5b414 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.062824 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.063407 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.063688 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.063983 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.064612 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.066260 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.076036 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1286/2573] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:04.079852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.089653 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e3736-d326-4bed-9a46-c5fc301c3917 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.094249 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b76402-c709-43bf-9ad5-0647b64dfc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.094836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b76402-c709-43bf-9ad5-0647b64dfc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.095598 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b76402-c709-43bf-9ad5-0647b64dfc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.095871 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b76402-c709-43bf-9ad5-0647b64dfc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.096531 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b76402-c709-43bf-9ad5-0647b64dfc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.098417 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b76402-c709-43bf-9ad5-0647b64dfc62 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.108105 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1288/2574] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:04.112665 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.122256 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79652c-6130-4408-9bc4-b6593a6aec25 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.126754 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.127382 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.127664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.127952 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] PATH_INFO: `/v3/projects/46507fef93444f4ba0523a940264a501/users/2f84c7f67dd449479eac5581e5c20716/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.141875 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46507fef93444f4ba0523a940264a501, user_id=2f84c7f67dd449479eac5581e5c20716, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.144462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.208404 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1287/2575] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:04 2022] PUT /identity/v3/projects/46507fef93444f4ba0523a940264a501/users/2f84c7f67dd449479eac5581e5c20716/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:04.218189 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810de71-b905-463c-9325-6db94437f232 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.222586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810de71-b905-463c-9325-6db94437f232 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.222586 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810de71-b905-463c-9325-6db94437f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.249107 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a810de71-b905-463c-9325-6db94437f232 None None] MFA Rules not processed for user `2f84c7f67dd449479eac5581e5c20716`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:04.250351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a810de71-b905-463c-9325-6db94437f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:04.311937 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1289/2576] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:04.316381 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.365987 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:04.376587 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb100-efe7-453b-9b81-f15b6848160c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.381145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.381764 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.382041 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.382309 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.382924 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.384795 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.530158 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1288/2577] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:01:04 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:04.534742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810de71-b905-463c-9325-6db94437f232 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.545480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810de71-b905-463c-9325-6db94437f232 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.601561 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.602185 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.602461 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.602752 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.603389 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.605365 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.722009 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1290/2578] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:04 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:04.726331 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.736460 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68129f7f-f753-46b3-8f66-98fb6296b719 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.740965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.741575 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.741865 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.742139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.742892 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.744463 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.754673 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1289/2579] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:04.758998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.769736 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3626369-c3b7-4d80-8373-1c94f428bde3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.774299 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.774932 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.775209 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.775480 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] PATH_INFO: `/v3/projects/3c2a636870ef4e13b0f59cd5e26b9970/users/9d50fca434534dd98bae42fc3769894d/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.790496 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2a636870ef4e13b0f59cd5e26b9970, user_id=9d50fca434534dd98bae42fc3769894d, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.793058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.865836 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1291/2580] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:04 2022] PUT /identity/v3/projects/3c2a636870ef4e13b0f59cd5e26b9970/users/9d50fca434534dd98bae42fc3769894d/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:04.869815 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.880215 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e755b1-33ba-491e-ba1e-37242a363b7e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.935071 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000cf39-9c98-4236-b504-bd56ef2794be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.935689 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000cf39-9c98-4236-b504-bd56ef2794be admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.935966 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000cf39-9c98-4236-b504-bd56ef2794be admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.936234 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000cf39-9c98-4236-b504-bd56ef2794be admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.936858 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000cf39-9c98-4236-b504-bd56ef2794be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.938465 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000cf39-9c98-4236-b504-bd56ef2794be admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.948599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1290/2581] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:04.952841 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:04.960213 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:04.963899 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8da7c-fffe-4401-be65-7d535b92a893 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:04.968460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:04.969103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.969424 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.969726 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] PATH_INFO: `/v3/projects/3c2a636870ef4e13b0f59cd5e26b9970/users/9d50fca434534dd98bae42fc3769894d/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:04.973327 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2a636870ef4e13b0f59cd5e26b9970, user_id=9d50fca434534dd98bae42fc3769894d, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:04.974761 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:04.984747 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1292/2582] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:04 2022] PUT /identity/v3/projects/3c2a636870ef4e13b0f59cd5e26b9970/users/9d50fca434534dd98bae42fc3769894d/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:04.995908 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:04.996212 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:04.996484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:05.025675 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] MFA Rules not processed for user `9d50fca434534dd98bae42fc3769894d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:05.026873 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:05.092577 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1291/2583] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:05.103708 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:05.105477 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:05.160961 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b8eb0-7467-43df-ae18-c723180ef7cc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:05.164498 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:05.165079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:05.165375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:05.165655 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:05.174873 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:05.176264 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:05.185405 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1293/2584] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:05.286473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:05.296164 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ace91-47b6-4798-a94c-53939fcdc61f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:05.300280 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ed122-0fde-482b-ba6b-fa6fc34439b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:05.300869 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ed122-0fde-482b-ba6b-fa6fc34439b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:05.301148 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ed122-0fde-482b-ba6b-fa6fc34439b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:05.301421 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ed122-0fde-482b-ba6b-fa6fc34439b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:05.344259 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:05.356666 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ed122-0fde-482b-ba6b-fa6fc34439b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:05.359304 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ed122-0fde-482b-ba6b-fa6fc34439b9 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:05.367462 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1292/2585] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:08.398571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:08.458979 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f755c1-3dbf-4918-96d6-b0e33284c1c2 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:08.463528 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:08.464154 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:08.464433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:08.464709 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] PATH_INFO: `/v3/users/2f84c7f67dd449479eac5581e5c20716` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:08.465892 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f84c7f67dd449479eac5581e5c20716)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:08.467796 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:08.662421 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f84c7f67dd449479eac5581e5c20716'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:08.663079 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f84c7f67dd449479eac5581e5c20716'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:08.676399 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f84c7f67dd449479eac5581e5c20716'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:08.740227 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f84c7f67dd449479eac5581e5c20716'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:08.747378 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f84c7f67dd449479eac5581e5c20716'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:08.753310 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1294/2586] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:01:08 2022] DELETE /identity/v3/users/2f84c7f67dd449479eac5581e5c20716 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:08.757827 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:08.758293 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:08.758408 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:08.777229 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:08.778832 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:08.836086 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1293/2587] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:08.846258 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:08.847676 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:08.861847 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:08.903179 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be601f-950a-4f6b-a300-b8a6654fe88a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:08.906782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:08.907967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:08.908241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:08.908507 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:08.917295 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:08.918668 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:08.928240 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1295/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:09.354368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:09.354368 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:09.358623 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbccac2-13c2-43a0-9429-c61bbf297dda None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:09.363200 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:09.363826 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:09.364092 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:09.364362 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] PATH_INFO: `/v3/projects/46507fef93444f4ba0523a940264a501` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:09.365468 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=46507fef93444f4ba0523a940264a501)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:09.367414 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:09.469645 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46507fef93444f4ba0523a940264a501', 'request_id': 'req-68e97217-4002-4d90-b436-f2ac84ea2aff'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.476257 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46507fef93444f4ba0523a940264a501', 'request_id': 'req-68e97217-4002-4d90-b436-f2ac84ea2aff'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.531692 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46507fef93444f4ba0523a940264a501', 'request_id': 'req-68e97217-4002-4d90-b436-f2ac84ea2aff'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.542061 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] The token cache is being invalidate because project 46507fef93444f4ba0523a940264a501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:01:09.542349 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.542964 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.544486 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1294/2589] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:01:09 2022] DELETE /identity/v3/projects/46507fef93444f4ba0523a940264a501 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:09.548604 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:09.558680 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571a35-5769-444d-8800-0639ec85caaa service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:09.613474 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:09.614106 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:09.614382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:09.614651 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] PATH_INFO: `/v3/users/9d50fca434534dd98bae42fc3769894d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:09.615737 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d50fca434534dd98bae42fc3769894d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:09.617659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:09.823308 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d50fca434534dd98bae42fc3769894d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.823879 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d50fca434534dd98bae42fc3769894d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.835809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d50fca434534dd98bae42fc3769894d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.897852 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d50fca434534dd98bae42fc3769894d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.905058 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-db6d2861-ad3f-4d64-967f-8a5d72b2e7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d50fca434534dd98bae42fc3769894d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:09.910985 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1296/2590] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:01:09 2022] DELETE /identity/v3/users/9d50fca434534dd98bae42fc3769894d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:10.333961 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:10.335364 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:10.348846 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e97217-4002-4d90-b436-f2ac84ea2aff admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:10.405775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:10.406409 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:10.406689 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:10.406965 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] PATH_INFO: `/v3/projects/3c2a636870ef4e13b0f59cd5e26b9970` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:10.408080 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2a636870ef4e13b0f59cd5e26b9970)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:10.410068 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:10.420484 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:10.533566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2a636870ef4e13b0f59cd5e26b9970', 'request_id': 'req-fc47ab21-622f-4732-9c5d-4638af7124c2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:10.539687 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2a636870ef4e13b0f59cd5e26b9970', 'request_id': 'req-fc47ab21-622f-4732-9c5d-4638af7124c2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:10.631351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2a636870ef4e13b0f59cd5e26b9970', 'request_id': 'req-fc47ab21-622f-4732-9c5d-4638af7124c2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:10.641558 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] The token cache is being invalidate because project 3c2a636870ef4e13b0f59cd5e26b9970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:01:10.641856 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:10.642476 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fc47ab21-622f-4732-9c5d-4638af7124c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:10.643969 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1295/2591] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:01:10 2022] DELETE /identity/v3/projects/3c2a636870ef4e13b0f59cd5e26b9970 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:10.648885 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:10.649345 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:10.652426 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:10.669012 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:10.670235 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:10.702015 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:10.730742 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1297/2592] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:10.739078 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:10.739366 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:10.739659 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:10.758757 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:10.759954 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:10.767765 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1296/2593] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:10.771881 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:10.781733 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ef962-da6e-4764-8ed2-771bae9e56f9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:10.786729 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:10.787319 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:10.787596 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:10.787868 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:10.788505 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 08:01:10.788806 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:10.790427 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:10.802119 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1298/2594] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 08:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 08:01:10.816035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:10.825222 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2278007-7743-4693-b89a-566520a9dca6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:10.829906 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:10.830599 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:10.831052 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:10.831495 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:10.832219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:10.834570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:10.913619 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1297/2595] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:01:10 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:10.917805 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:10.928557 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297901-86ae-45fe-885f-239fe25b5fc2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:10.983275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:10.983867 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:10.984144 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:10.984415 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:10.985039 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:10.987577 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.059739 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1299/2596] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:10 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:11.063854 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.074797 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496860-a9e3-4114-acc4-93e19daa8dae admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.079413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.079997 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.080285 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.081035 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.081700 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.083273 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.093511 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1298/2597] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:11.098224 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.108192 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb948645-7d76-42d7-903a-f5daab86e85f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.112773 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c3741-2670-41dc-8509-c916e9562a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.113356 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c3741-2670-41dc-8509-c916e9562a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.113656 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c3741-2670-41dc-8509-c916e9562a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.113928 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c3741-2670-41dc-8509-c916e9562a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.114556 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c3741-2670-41dc-8509-c916e9562a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.116110 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c3741-2670-41dc-8509-c916e9562a8b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.126443 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1300/2598] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:11.130297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.140085 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d511-9d4c-4d30-aee4-4a043cfe5ab9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.145329 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.145991 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.146270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.146541 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] PATH_INFO: `/v3/projects/3d48e63f6d0044c8ab433772f2264b9e/users/0c5185d70ca54e6e86dcc975f55c01ca/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.162207 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d48e63f6d0044c8ab433772f2264b9e, user_id=0c5185d70ca54e6e86dcc975f55c01ca, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.164850 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.263748 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1299/2599] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:11 2022] PUT /identity/v3/projects/3d48e63f6d0044c8ab433772f2264b9e/users/0c5185d70ca54e6e86dcc975f55c01ca/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:11.275663 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.275958 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.276238 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.304010 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] MFA Rules not processed for user `0c5185d70ca54e6e86dcc975f55c01ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:11.305272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:11.367439 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1301/2600] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:11.371871 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.432021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106ca10-95cd-4ef2-9be1-acab2ebe84e2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.436601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.437194 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.437473 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.437770 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.438395 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.440767 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.524270 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1300/2601] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:01:11 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:11.528242 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.538751 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c48f9-b6b4-48a4-849c-f32348687247 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.567276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:11.594778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.595381 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.595659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.595933 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.596612 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.598811 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.683502 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1302/2602] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:11 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:11.687455 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.698385 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8087c8-a318-4bc0-b26c-580be4e60873 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.703186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.703778 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.704083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.704351 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.704985 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.707219 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.717775 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1301/2603] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:11.721788 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.731874 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fda570-b2fe-4457-b2d7-d5a6a1257abf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.736419 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.737056 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.737336 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.737635 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] PATH_INFO: `/v3/projects/12827d034f464798a3f9547db82a64c2/users/92622957230949da925c8f5edbeb8ca2/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.751973 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12827d034f464798a3f9547db82a64c2, user_id=92622957230949da925c8f5edbeb8ca2, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.755141 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.823398 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1303/2604] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:11 2022] PUT /identity/v3/projects/12827d034f464798a3f9547db82a64c2/users/92622957230949da925c8f5edbeb8ca2/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:11.830585 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.840438 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023d54-7e13-4656-a953-e585c4ec4331 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.844944 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:11.896697 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9662-a65a-49b6-8dbb-a2f03c9fdb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.897300 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9662-a65a-49b6-8dbb-a2f03c9fdb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.897607 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9662-a65a-49b6-8dbb-a2f03c9fdb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.897888 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9662-a65a-49b6-8dbb-a2f03c9fdb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.898521 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9662-a65a-49b6-8dbb-a2f03c9fdb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.900139 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9662-a65a-49b6-8dbb-a2f03c9fdb71 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.909787 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1302/2605] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:11.913905 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:11.924688 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858a2ce-2df9-4871-bbfd-8f8e1a76cc0a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:11.929320 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:11.929996 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.930275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.930549 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] PATH_INFO: `/v3/projects/12827d034f464798a3f9547db82a64c2/users/92622957230949da925c8f5edbeb8ca2/roles/ad25590df6c74ef39a4e887754ee34ab` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.932460 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12827d034f464798a3f9547db82a64c2, user_id=92622957230949da925c8f5edbeb8ca2, role_id=ad25590df6c74ef39a4e887754ee34ab)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:11.935173 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:11.945778 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1304/2606] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:11 2022] PUT /identity/v3/projects/12827d034f464798a3f9547db82a64c2/users/92622957230949da925c8f5edbeb8ca2/roles/ad25590df6c74ef39a4e887754ee34ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 08:01:11.956601 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:11.957178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:11.957721 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:11.985138 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] MFA Rules not processed for user `92622957230949da925c8f5edbeb8ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:11.986358 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:12.052396 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1303/2607] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:12.063261 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:12.065518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:12.120913 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e433e-48c4-4e51-b9db-af1cc05a2833 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:12.124475 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:12.125063 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:12.125340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:12.125649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:12.134963 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:12.136361 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:12.145518 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1305/2608] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:12.343831 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:12.354336 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031642-8e99-4408-a884-ef5d0bf83560 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:12.358044 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df009a56-3423-4c7c-a78e-a40ece9d26d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:12.358634 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df009a56-3423-4c7c-a78e-a40ece9d26d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:12.366806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df009a56-3423-4c7c-a78e-a40ece9d26d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:12.366806 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df009a56-3423-4c7c-a78e-a40ece9d26d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:12.415083 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df009a56-3423-4c7c-a78e-a40ece9d26d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:12.416504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df009a56-3423-4c7c-a78e-a40ece9d26d0 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:12.426190 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1304/2609] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:18.708199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:18.794700 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:18.810727 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675f77-91b0-409b-a2c9-94c78a9d4407 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:18.815316 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:18.815965 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:18.816244 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:18.816517 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] PATH_INFO: `/v3/users/0c5185d70ca54e6e86dcc975f55c01ca` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:18.817649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5185d70ca54e6e86dcc975f55c01ca)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:18.820164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:18.992750 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5185d70ca54e6e86dcc975f55c01ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:18.993402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5185d70ca54e6e86dcc975f55c01ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.005494 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5185d70ca54e6e86dcc975f55c01ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.077188 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5185d70ca54e6e86dcc975f55c01ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.084441 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5185d70ca54e6e86dcc975f55c01ca'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.090870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1306/2610] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:01:18 2022] DELETE /identity/v3/users/0c5185d70ca54e6e86dcc975f55c01ca => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:19.095483 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:19.095941 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:19.096051 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:19.135292 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:19.136745 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:19.140581 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:19.195513 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1305/2611] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:19.205272 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:19.206675 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:19.279569 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adb66a-7775-4440-89a2-297e016e4316 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:19.283187 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:19.283786 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:19.284066 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:19.284339 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:19.293184 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:19.294670 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:19.304783 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1307/2612] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:19.679322 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:19.680712 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:19.694515 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a646a6f-0570-4f7e-8c74-d7e8ada6b420 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:19.699809 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:19.700606 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:19.700958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:19.701145 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] PATH_INFO: `/v3/projects/3d48e63f6d0044c8ab433772f2264b9e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:19.702915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d48e63f6d0044c8ab433772f2264b9e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:19.704808 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:19.819848 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d48e63f6d0044c8ab433772f2264b9e', 'request_id': 'req-8d5dba59-6519-408e-a439-87586e0d0187'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.826033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d48e63f6d0044c8ab433772f2264b9e', 'request_id': 'req-8d5dba59-6519-408e-a439-87586e0d0187'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.893976 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d48e63f6d0044c8ab433772f2264b9e', 'request_id': 'req-8d5dba59-6519-408e-a439-87586e0d0187'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.904711 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] The token cache is being invalidate because project 3d48e63f6d0044c8ab433772f2264b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:01:19.905021 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.905655 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:19.907115 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1306/2613] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:01:19 2022] DELETE /identity/v3/projects/3d48e63f6d0044c8ab433772f2264b9e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:19.911241 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:19.921340 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e56e21-8288-4fab-932c-a7ff9a9c45a9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:19.967514 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:19.977941 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:19.978945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:19.978945 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:19.979130 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] PATH_INFO: `/v3/users/92622957230949da925c8f5edbeb8ca2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:19.980251 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92622957230949da925c8f5edbeb8ca2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:19.982195 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:20.322305 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92622957230949da925c8f5edbeb8ca2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:20.322946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92622957230949da925c8f5edbeb8ca2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:20.334280 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92622957230949da925c8f5edbeb8ca2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:20.399758 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92622957230949da925c8f5edbeb8ca2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:20.406620 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6702febc-bbcc-4bf3-b8eb-b94983138ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92622957230949da925c8f5edbeb8ca2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:20.412377 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1308/2614] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:01:19 2022] DELETE /identity/v3/users/92622957230949da925c8f5edbeb8ca2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 08:01:20.787210 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:20.788710 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:20.802039 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dba59-6519-408e-a439-87586e0d0187 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:20.859378 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:20.859996 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:20.860277 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:20.860546 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] PATH_INFO: `/v3/projects/12827d034f464798a3f9547db82a64c2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:20.861684 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12827d034f464798a3f9547db82a64c2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:20.863570 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:20.970365 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:20.979691 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12827d034f464798a3f9547db82a64c2', 'request_id': 'req-586589a6-4f70-4fb9-87cd-58817918903e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:20.985773 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12827d034f464798a3f9547db82a64c2', 'request_id': 'req-586589a6-4f70-4fb9-87cd-58817918903e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:21.054410 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12827d034f464798a3f9547db82a64c2', 'request_id': 'req-586589a6-4f70-4fb9-87cd-58817918903e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:21.064793 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] The token cache is being invalidate because project 12827d034f464798a3f9547db82a64c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:01:21.065286 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:21.066380 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-586589a6-4f70-4fb9-87cd-58817918903e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:01:21.067910 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1307/2615] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:01:20 2022] DELETE /identity/v3/projects/12827d034f464798a3f9547db82a64c2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:21.073579 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.074054 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.074273 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.130716 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:21.131946 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:21.189809 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1309/2616] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:21.197664 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.197958 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.198233 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.218390 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:21.219596 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:21.228566 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1308/2617] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:21.232725 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.242854 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2154036-a5a6-4c41-95f2-e40421956ad4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.247308 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.247893 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.248170 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.248440 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.249082 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 08:01:21.249382 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.250974 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.262317 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1310/2618] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Nov 2 08:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 08:01:21.266340 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.275223 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4023d-e589-436c-a51c-1d9c710dce6f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.279752 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.280332 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.280608 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.280877 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.281503 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.283383 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.383882 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1309/2619] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Nov 2 08:01:21 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 08:01:21.387967 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.397948 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb70062-e727-4e34-9a0c-06d7486faf84 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.421810 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:21.452400 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.452998 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.453275 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.453568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.454199 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.456094 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.557146 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1311/2620] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Nov 2 08:01:21 2022] POST /identity/v3/users => generated 282 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 08:01:21.561077 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.571376 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6144fc-81f0-416c-8022-d7cf56738ae6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.576049 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.576636 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.576914 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.577186 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.577859 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.579504 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.590348 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1310/2621] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 08:01:21.594281 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.605038 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99389af-3e68-42ec-b2ed-a7d4b50e7f89 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.609677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10655052-97c6-4716-a323-1042b3ae0891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.610274 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10655052-97c6-4716-a323-1042b3ae0891 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.610578 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10655052-97c6-4716-a323-1042b3ae0891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.610849 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10655052-97c6-4716-a323-1042b3ae0891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.611478 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10655052-97c6-4716-a323-1042b3ae0891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.613053 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10655052-97c6-4716-a323-1042b3ae0891 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.623745 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1312/2622] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Nov 2 08:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 08:01:21.627705 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.637514 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a976-22f1-474d-b7e0-d38319d5f119 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.642048 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.642683 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.642959 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.643231 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] PATH_INFO: `/v3/projects/9a4ae809f7f24d8b85476d2c10a242db/users/601a5321b7054fc8ab3bae4c8376fa87/roles/87acec30d5ae421e8ff804046c98950a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.659413 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4ae809f7f24d8b85476d2c10a242db, user_id=601a5321b7054fc8ab3bae4c8376fa87, role_id=87acec30d5ae421e8ff804046c98950a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.662276 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.760149 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1311/2623] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Nov 2 08:01:21 2022] PUT /identity/v3/projects/9a4ae809f7f24d8b85476d2c10a242db/users/601a5321b7054fc8ab3bae4c8376fa87/roles/87acec30d5ae421e8ff804046c98950a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:01:21.771915 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.772230 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.773013 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.801402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] MFA Rules not processed for user `601a5321b7054fc8ab3bae4c8376fa87`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:01:21.802681 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:21.866284 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1313/2624] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:01:21.877123 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:01:21.878847 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:01:21.936363 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efcc1-0dbb-47d7-bdc4-1e31acbf4230 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:01:21.940033 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f8e72-859b-4fa1-b7aa-50eb99eb0ee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f95b0b156df4f26a498c8d332cc100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:01:21.940637 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f8e72-859b-4fa1-b7aa-50eb99eb0ee1 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:01:21.940915 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f8e72-859b-4fa1-b7aa-50eb99eb0ee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:01:21.941188 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f8e72-859b-4fa1-b7aa-50eb99eb0ee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:01:21.950611 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f8e72-859b-4fa1-b7aa-50eb99eb0ee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:01:21.952030 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f8e72-859b-4fa1-b7aa-50eb99eb0ee1 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:01:21.961828 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1312/2625] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:01:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:01:31.862988 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:01:31.956834 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:02:00.727026 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:02:00.788870 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3762a4-c972-4fd2-b69e-480a4f8dcfd1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:02:00.793446 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:02:00.794120 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:02:00.794376 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:02:00.794647 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] PATH_INFO: `/v3/users/601a5321b7054fc8ab3bae4c8376fa87` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:02:00.795755 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601a5321b7054fc8ab3bae4c8376fa87)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:02:00.797677 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:02:00.940749 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601a5321b7054fc8ab3bae4c8376fa87'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:00.941396 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601a5321b7054fc8ab3bae4c8376fa87'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:00.953869 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601a5321b7054fc8ab3bae4c8376fa87'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.027276 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601a5321b7054fc8ab3bae4c8376fa87'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.034287 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601a5321b7054fc8ab3bae4c8376fa87'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.040402 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1314/2626] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Nov 2 08:02:00 2022] DELETE /identity/v3/users/601a5321b7054fc8ab3bae4c8376fa87 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:02:01.044704 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:02:01.045193 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:02:01.045306 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:02:01.064641 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] MFA Rules not processed for user `395a2fc08e264060911329b9f2474d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 08:02:01.065844 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:02:01.122024 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1313/2627] 10.222.0.26 () {58 vars in 958 bytes} [Wed Nov 2 08:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 08:02:01.131571 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:02:01.133659 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:02:01.190202 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c20d4-3d4d-4c15-8149-172d518f8453 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:02:01.193782 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d217e156e944c3ba7dbbab90344e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:02:01.194375 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:02:01.194645 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:02:01.194910 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:02:01.203568 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:02:01.205023 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:02:01.214103 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1315/2628] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:02:01.623427 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:02:01.624904 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:02:01.637122 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649584-c776-4eaa-9754-bfc5d20e3e1f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:02:01.641994 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395a2fc08e264060911329b9f2474d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a48f833e014547bea9a266aeb3854e0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:02:01.642626 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:02:01.642903 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:02:01.643178 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] PATH_INFO: `/v3/projects/9a4ae809f7f24d8b85476d2c10a242db` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:02:01.644307 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4ae809f7f24d8b85476d2c10a242db)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:02:01.646239 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:02:01.749940 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4ae809f7f24d8b85476d2c10a242db', 'request_id': 'req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.756297 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4ae809f7f24d8b85476d2c10a242db', 'request_id': 'req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.863867 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4ae809f7f24d8b85476d2c10a242db', 'request_id': 'req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.874345 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] The token cache is being invalidate because project 9a4ae809f7f24d8b85476d2c10a242db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 08:02:01.876031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.876031 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aed7cbf8-1e5e-432a-b330-3eb0ec7b0f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 08:02:01.876738 dv-cinder-804735-33-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1314/2629] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Nov 2 08:02:01 2022] DELETE /identity/v3/projects/9a4ae809f7f24d8b85476d2c10a242db => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 08:02:11.210649 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:02:11.871282 dv-cinder-804735-33-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:02:31.579360 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:02:31.580754 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:02:31.668164 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14c40-7881-47a8-8106-c3039d60f6d9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:02:31.726837 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '856250812d2b4bcdaa732efe4f7e9fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b7d9161195b4ee0908523c82f5c3919', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:02:31.727433 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:02:31.728290 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:02:31.728567 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:02:31.730351 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:02:31.741379 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:02:31.744876 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a567993-9017-46b4-ad9e-2e90b8f00d8c service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:02:31.752618 dv-cinder-804735-33-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1316/2630] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Nov 2 08:02:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:02:41.748491 dv-cinder-804735-33-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=67 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}